Login to participate
  
Register   Lost ID/password?

Louis Kessler’s Behold Blog

Programming is like Songwriting - Sun, 11 Feb 2018

A programmer develops an original idea for a program and spends time writing it. Once you’ve got it working to some point, you put it online and test the waters. If it’s well taken, you go out on tour.

A songwriter develops some original ideas for some new songs and spends time putting the tracks together. Once the album is published and the tunes are liked to some point, they go out on tour.

One year’s the writing year. The next year’s the touring year.

I worked for many years until Version 1.0 of Behold was ready. I released it in 2011. It was time to test the waters.

In 2012, I entered Behold as a contestantName Badge 2012 in the 2012 RootsTech Developers Challenge and it was accepted. 2012 then saw me “on tour” as I attended the 3rd RootsTech in Salt Lake City, presenting Behold and meeting with other developers, genealogy bloggers and BetterGEDCOM folk as well as being on a panel discussing Sources where a few statements I said about source-based genealogy were to my surprise met with huge applause. Early 2013, I picked up my genealogy “tour” as a speaker on the 3rd Unlock the Unlock the Past Speaker - Cruises 3 and 10Past genealogy cruise where I met my Australia genie friends for the first time.

During 2013, I continued work on Behold, and by the end of the year got it up to version 1.0.5.1.

2014 was another a touring year. It was back to my 2nd RootsTech where I was a speaker. In October, it was over the pond to Leiden, Netherlands where I spoke at the Gaenovium Conference organized by Tamura Jones.

During 2015, it was back to work, I finished and released Behold 1.2.

That was followed in 2016 by the 10th Unlock the Past Genealogy Cruise around New Zealand and Australia. It was there that Judy Russell coerced me into DNA analysis, so I took the leap and found that DNA now occupied and took over every spare moment left in my life. I needed something to analyze this mass of data, so I developed Double Match Triangulator for my own needs. When RootsTech later that year announced the Innovator’s Showdown for innovative genealogy products, I thought: “what the heck”, and submitted DMT, went to RootsTech 2017 and DMT took 3rd place.

image

Thus started the biggest “tour year” of my life, with me giving a workshop on DMT at the 37th IAJGS Conference in July in Orlando, with me giving DNA talks at the 2nd Great Canadian Genealogy Summit in October in Halifax, and then my attending the 13th Annual International Conference on Genetic Genealogy put on by Family Tree DNA in Houston in November.

My “songs” are different from everyone else. Programs are like music. You can either like my style or not. Everyone has their own taste as to what type of “music” they like and what soothes their soul. As a “writer”, I choose to “write” what I want to “listen” to. If others happen to like my “songs” as well, then that’s great. If not, I completely understand.

There are a lot of genealogy programs out there, as the almost 1000 programs at my GenSoftReviews site can attest to. Choosing the right program and what works best for you is a personal decision, just like buying a car, clothing, or anything else. We are all different. All I can say is, I’ve got my little niche here of what I’m trying to do and where I’m going with Behold and DMT and maybe I’ll pop another surprise in there.

Songwriting and programming can be a lonely task. Stuck in an office for hours on end, only coming out for that caffeine break, or a walk to the mailbox to get some fresh air and clear the mind.

Just like a songwriter, programmers can get stuck on a line for a few hours, for a day or two, or sometimes even for a week or two. The best inspiration comes in bed at 3 a.m., in the shower, or out for a walk.

It takes motivation and inspiration to keep going sometimes. And other times, the ideas just come and the code just flows and you look forward to the sun rising on a bad-weather day so you can get right back to it.

Innovation is the bottom line. We don’t need “same old”. RootsTech got it right when they say they’re looking for innovation. There are so many ways the genealogist’s work can be enhanced and made easier. It’s only a matter of figuring out how to do it. I’ve lost count of how many neat and imaginative features I’ve added into Behold and DMT. I challenge all other genealogy/DNA programmers to go do it. Think outside the box.

I recently added the following “philosophies” to my DMT Thanks page:

  • Part of the imagining … is imagining what to do
    when something’s not been done before.
  • The person who says it cannot be done
    should not interrupt the person doing it.

So after my big 2017 tour year, I’ll be taking it “easy” in 2018, staying at home and programming. Here’s my ribbon this year, courtesy of Christine Woodcock:

2018 is my year of “writing”. I just released DMT 2.0. I’m now working on Behold 1.3 and my New Year’s Resolution is to release Behold 1.5 by the end of the year (Saving GEDCOMs and its own database).

If I can then do some more imagining towards the end of the year, then maybe DMT 3.0 will actually map your chromosomes for you – at least that’s my hope.

And the year after that 2019 could start with a beta of Behold 2.0, when I attempt to finally turn it into the full featured genealogy data editor that I’ve always imagined it would be.

Maybe then, I can actually start to use it to get back to my own genealogy, which has been in abeyance for 20 years. Wouldn’t that be something!

A 2019 genealogy cruise with Unlock the Past would be a wonderful way to celebrate that.

image

So I’m busy. And I won’t be touring this year. However, that doesn’t mean I won’t be active.

On Monday February 26, I’ll be giving a talk called: “DNA, the Journey” to the Manitoba Genealogy Society here in Winnipeg.

Of course, February 28 to March 3 is RootsTech 2017, and I’ll be watching the live streaming and I’ll be staying involved on the social networks.

And on Saturday March 17, I’ll be answering questions in a #genchatDNA session about triangulation on Twitter:

Life is good. Enjoy the music!

Double Match Triangulator 2.0 - Tue, 6 Feb 2018

I’ve just released a new version of DMT, with many improvements.

 

Excel No Longer Required

The previous version of DMT used a technique called Excel Automation to generate its Excel files. It used the Excel libraries that would be installed on your computer with Excel, so DMT required that you had at least version 2007 of Excel installed in order for it to create Excel output for you. Otherwise DMT would create unformatted csv (comma delimited) files.

Now DMT uses a 3rd party package called FlexCel that is no longer dependent on having Excel itself installed on your computer.

It also gets around lockups that used to occur if you tried using Excel while DMT was creating its files.

Not only that, the generation of the Excel files is about 4 times faster.  Also, the files produced are much smaller than they were previously.

DMT now always produces Excel .xlsx files and no longer produces csv files. You do not need Excel on your computer to read them. Open Office, Google Sheets and other spreadsheets can read Excel files. 

 

Download Helper for GEDmatch

GEDmatch has a Tier 1 Utility called Matching Segment Search that produces an online report with your segment match data. However, it has no download capability. You had to copy it from the webpage and paste it into a spreadsheet and then save that to your computer.

image

Now DMT has a “Save GEDmatch” button to simplify that process. You run the Matching Segment Search at GEDmatch. When the report is ready, you select the whole report and copy it to the clipboard. Then press the Save GEDmatch button and DMT will create a csv (comma delimited) file containing the GEDmatch match data from the report.

 

Direct Reading of 23andMe and GEDmatch Match Files

Previously, if you had match data downloaded from 23andMe, you had to convert it to Family Tree DNA’s Chromosome Browser Results format to use. Now DMT can directly read 23andMe’s Relatives Download file containing its segment match data.

The same was true for GEDmatch data. You used to haveto convert it to FTDNA format. Now DMT can directly read GEDmatch data in the csv files created by  new “Save GEDmatch” button.

 

Improved Reading of FTDNA Files

Family Tree DNA Chromosome Browser Download files list all the segment matched by the tester’s name. Older downloads often had extra spaces in the names, e.g. two spaces between the first name and the last name instead of just 1. Sometime in 2017, FTDNA corrected this problem.

Since FTDNA does not include the kit number in the file, DMT must use the person’s name for matching. The extra spaces in older files would prevent the people from being matched up with those in newer files. DMT now removes extra spaces from the names in FTDNA’s match files before it does its comparison.

 

32 bit and 64 bit Versions

DMT used to only be a 32-bit program. It now comes as 32-bit or 64-bit. If you have a 64-bit computer, the 64-bit version will automatically be installed on your computer. Otherwise, the 32-bit version will be installed.

 

Triangulations Separated from Missing AB Matches

Previously, in the Map output, all double matches were denoted by green X’s, whether or not they were triangulations or missing AB matches. Now the green X’s only represent triangulations. Missing AB matches are shown as grey m’s and are the double matches that don’t triangulate.

Version 1.5.1:

image

Version 2.0:

image

 

Combine All Results Now Groups AC Matches Together

The option named: “Analysis by Chromosome” didn’t really reflect its true purpose. It has now been renamed to “Combine All Results”.

The results are still combined into separate chromosome result files since they could become too large otherwise, but that is just a result, not the purpose.

The combined files used to be presented simply as the individual AB runs assembled together with the triangulation groups from the AB runs left intact.

I’ve realized since then, that there is great value to keep all the B matches for each AC match together and to display the B matches with other B matches first. This will allow you a better chance to identify and place the AC match to the common ancestor it may come from.

Version 1.5.1:

image

Version 2.0:

image

 

Unregistered Version Now Shows Full Names For Chr 1

Previously, the unregistered version of DMT would not show Person C names. This likely made it harder to evaluate the worth of DMT.

Now the unregistered version of DMT will show actual output, but only for Chromosome 1. To see the remaining chromosomes, a one-time purchase of a lifetime license of DMT is required.

 

Many Other Improvements and Fixes

Many tweaks were made to the user interface, reports and log files and several bugs were fixed. Some of these items include:

  • Now using a standard Windows folder dialog for the picking of a folder,
  • Removed the “Used 0 files” line that was incorrectly being shown,
  • Files will now still process if only some lines have errors,
  • Improvements to the way recently used files are chosen,
  • Person A’s file is now read only once per run.

The GEDmatch Relationship Tree tool - Wed, 24 Jan 2018

I hadn’t tried this one before. Have you?

image

It’s a Tier 1 tool, so you have to pay GEDmatch the $10 a month to use it.

What an imaginative innovative idea. They’re using expected autosomal sharing and expected X sharing between two people to determine relationships and they show a tree for the two people. When I run myself against one of my closest X matches on GEDmatch (28 cM shared X, 42 cM shared autosomal) who I have no idea how I’m related to, after increasing the overlap from 1 (which gave no results) to 2, I get this:

image

What it tells me, is that using rules of how autosomal DNA and X-DNA is passed from parent of a given sex and child of a given sex, my shared amounts with this person most closely match the estimates for two relationships (as shown in the chart above). This person is most likely my 3rd cousin in one of these two ways:

  1. My mother’s father’s mother’s sister’s son’s daughter’s daughter.

  2. My mother’s father’s mothers’ sister’s daughter’s son’s daughter.

This doesn’t preclude other ways that we could be related. I could increase the overlap to 3 and get more possibilities. But it does give some insight as to what the relationship might be.

At GEDmatch they say this tool is experimental. It’s been around a few years and there is very little documentation about it. The best writeup I’ve seen is one by Israel Pickholtz in 2014.

How does it work?

Well that exact question was asked on my favorite Genealogy and Family History Question and Answer Site, and you can see my answer there.

Does the tool help? Well. I’m going to email that person, and ask her if her who her mother’s father’s mother and her father’s mother’s mother were and where they were from and see if they can connect to my mother’s father’s mother.

With regards to using relationship techniques like this in genealogy software like Behold or DNA analysis tools such as Double Match Triangulator, I have some ideas. Stay tuned.

—-

Update Jan 25:  I contacted the person administering the account who was an APG member administering lots of DNA kits. He pointed out that I didn’t read the instructions correctly and entered the wrong values. It wanted autosomal and X values from the 1 to 1 tool and I used the values from the one-to-many tool. He also said the person I matched to was likely a generation different from me. That doesn’t affect anything I say in the post about the tool, but only means it is using example input.

So I entered the correct values into the Relationship Tree tool and it now gave a single result, not too much different than what is in the diagram above. At 3rd cousins once removed, the line we might be related to is at least one generation further than either of us have been able to genealogically research.

None-the-less, try the tool. It may help you if both you and your match have genealogically researched enough generations back on the possible connecting lines.