How to Analyze GEDCOM Files Efficiently with GEDminer

I've been looking forward to trying GEDminer, a GEDCOM analyzer. I'm going to resist the temptation to compare it to other consistency checkers I've used, because this one is exceptional and outshines any other I've tried. On the features page you'll find the brief description of:

"Upload a GEDCOM file and instantly access 12+ genealogy analysis tools — demographics, migration maps, error detection, census gaps, kinship calculation, and more."

I gotta tell you, when they say "and more" they mean it! I'm not going to list every feature (the list is simply too long) but even if you don't try it, it's worth heading over to the features page to see the potential it might offer, if and when you need it. Given this is a totally FREE site, and your data is parsed in your browser so it never leaves your computer, you can feel confident when using this tool.

While the site is totally FREE, you can register for an account if you wish. You can also support the site with a donation if you feel inclined to do so. With an account, you can save up to 3 trees. The data saved is parsed and only includes names, dates, places, and relationships. One feature I don't often see, but they offer, is the option to replace a file with a newer version - a feature I've longed for on sites like MyHeritage. If you don't sign up for an account, nothing is saved at all. 

On the Overview page, you'll find some stats as well as an "on this day" feature outlining births, deaths, and marriages on given dates. My sourcing and citations were 98-99%, but my completeness score is 73% - giving me an overall score of 88.79%. Given I know I'm missing some crucial dates, this was expected. To give you an idea of the user interface, here's a screenshot of my overview:

Clicking on any of the issues listed provides more explanation and detail. There's even a section for "quick wins" (sortable by impact or effort required) to help quickly improve your scores. Each page appears to have numerous filter and sort options.

The other main pages are:

• Directory (People, Occupations, Locations and Kinship)
• Integrity (Suggestions, Errors, Vital Sharpener, and Tree Structure)
• Discovery (Migration Analysis, Census Toolbox, Gap Detector, Incomplete Families, DNA Planner and Plan Generator)

I do want to take a moment to call out the Census Toolbox. A quick look at mine shows I moved on from the 1850 to the 1860 census, and I've done a fairly good job with it. But many other census years are really lacking in my research (just as I alluded to in a recent post). 

It goes a step further and suggests all the potential missing censuses, not just from the US, but other countries as well. (Clearly, I have a lot of work to do!!)

If you're still not sure about trying it, head on over to Fortify Your Family Tree - This Free, Elegant GEDCOM Analyzer Is a Wonder for a more in depth review. 

I've barely scratched the surface on this wonderful resource. You truly have to see this in action to appreciate all the features. Each page is filled with useful insights to help you uncover patterns, find potential errors and identify where more research is needed. I find the clear graphics and color coding very satisfying. The data is presented in clear, easy to understand format. This site is also linked in my Genealogy Toolbox under GEDCOMs. 

If you aren't already using this site, give it a try and let me know your thoughts! 

Image by Clker-Free-Vector-Images from Pixabay

Detailed Instructions for Using RootsMagic to Create a Minimal GEDCOM

 I like to have my tree on multiple sites. A few times a year, I've been creating a GEDCOM from either Ancestry or Family Tree Maker (FTM) and uploading it to MyHeritage and Findmypast. These are simply the sites I choose to use. If and where to upload GEDCOMs is a personal preference, depending on your specific needs.

There  are numerous other sites and software where GEDCOMS are accepted. Reasons one might want to upload could include:

• My #1 reason - having easy access to hinting from the sites I subscribe to
• Keeping multiple online backups
• Searching for more DNA matches
• Collaborating with relatives and family groups
• Utilizing specific research tools provided by software or websites

GEDCOM files generally contain a lot of information, most often including citations and facts, and potentially media depending on the program used to create the file. I've long wanted to be able to create a minimal GEDCOM, since all I'm interested in is hinting. I wanted a GEDCOM with only name, birth date/location, death date/location, marriage/location and divorce/location. I only want the basics...just enough to provide sufficient data to prompt the algorithms for hints. 

My preferred desktop software is FTM. I can absolutely export a GEDCOM, but the options for filtering the contents are slim. Ancestry provides a one-size-fits-all download solution, no editing options there. GEDCOMs can be manually edited, but it's simply not a viable option for trees with large amounts of people and data. At one point, I found a website where they used to offer a program with the ability create exactly the file I was after (called The Complete Genealogy Builder). Sadly, the software has been discontinued and is no longer available for purchase. I didn't want to have to buy (or learn) new software specifically for creating these GEDCOMs. With a little persistence, I found a way to do it reasonably easily with RootsMagic. While not my preferred software, I do have the most recent paid version (RM11). According to Google, you very may be able to do this process with the free version, RootsMagic Essentials, as well. It does take a few minutes of setup each time you want to create this type of GEDCOM, but it's by far the easiest way I've found to do it. Here's are the detailed steps.

First, export your GEDCOM from your preferred software, or download from your preferred site, such as Ancestry. (Note: If you're a RootsMagic user, I'd still recommend exporting and working with the GEDCOM separate from your main research tree. If anything goes wrong or you make an error, you don't want to risk messing up all your hard work!) Since the main sites I upload to already privatize living people, I don't worry about doing it in my GEDCOM. But it's important to double check how the uploaded file is handled on each site. As an example, GEDmatch requires you to privatize your own file. Be sure you check each site's requirements so you don't encounter any unexpected surprises or problems.

Once you have your initial GEDCOM, import it into RootsMagic by selecting File > Create a New RootsMagic File > Import > GEDCOM > and select the location of your GEDCOM file.

Then, open your newly created file and select Tools > Fact Tools > Add or Modify Fact Types. Then Run the Selected Tool. You should have a screen like this:

Next is the most time consuming part. You'll need to edit each fact you don't want in the GEDCOM. Select the Fact Type and click Edit. You'll want to UNCHECK Include When Exporting GEDCOM Files. Then click OK. (Facts have this box checked by default). 

For facts you are keeping in the GEDCOM (especially if you use custom facts) be sure to check each one to determine if Use Description Field is included by default or not. You may wish to make adjustments to include or exclude them, depending on the purpose of your GEDCOM, and the information you're entering in the field. As an example, I have custom Marriage and Divorce fields to record timeline events for additional spouses I'm not researching or including in my tree. These facts are set up as individual person facts (not family or shared facts as the standard Marriage and Divorce facts are). In these cases, I include the name of the additional spouse in my description. Even on a minimal GEDCOM, I want to have the names visible when I upload to another site, so I must ensure those facts are using the Description.

You'll have to go thru every fact type one by one. When you're done excluding all the facts you don't want, and verifying the description use on the fields you do want, click OK on the bottom of the Fact Types screen. 

This is where I wish there was an option to save, but unfortunately, there is not. You'll have to repeat this process each time you want to create a minimal GEDCOM. CAUTION: Your fact changes will be lost after you exit the file you're working with, regardless of whether you save it or not.  It's critical you do the GEDCOM export prior to closing the file you're working with. The good news? Now, you're ready to export your modified GEDCOM! 

Click on File > Export Data > GEDCOM

From here, you can specify where you want the file exported. I recommend reimporting the file into RootsMagic (or your preferred software) to double check and make sure everything looks just as you want it. Once you've verified, you're ready to upload to the sites or software where you want to use this GEDCOM. 

Here are links on how to import GEDCOMs to the major websites:

• Ancestry - Uploading a Family Tree
• MyHeritage - How do I upload (import) a GEDCOM file to my family site on MyHeritage?
• Findmypast - How to import your family tree using a GEDCOM file
• FamilySearch - How do I upload my GEDCOM file?
• GEDmatch - Uploading a GEDCOM File on GEDmatch - Genetic Genealogy Research (VIDEO)

I've also updated my Genealogy Toolbox to include these links, under GEDCOMs, in case you'd like to reference them in the future.

There are any number of reasons you might want to create a minimal GEDCOM. The facts you wish to include may be completely different than those I use. But the creation process is the same! It only takes 1/2 hour or so to create a minimal GEDCOM using RootsMagic. Perhaps in the future more software or websites will offer easier ways to do this, but this process accomplishes the goal without the need for time consuming manual editing or purchasing additional software. If you've long wanted a way to do this, or if you've found other easier ways to do it, let me know! 

Privatizing GEDCOMs: When and Why It Matters

For those interested in uploading their GEDCOM to other sites to gain hints, new DNA matches or simply to enhance your research, making sure living people are privatized and/or protected is extremely important. Different sites have different policies and requirements. While most sites have a policy in place to try to protect the identity of living individuals, it's important to know, before you upload exactly what you're sharing. I'm going to take a look at some of the most common places users upload GEDCOMs and the default privacy practices, for living people, of each site.

As anyone who's done genealogy for any period of time knows, it doesn't take a lot of information for someone to be able to track down additional data on living people. It's fine if you're tracking it down for your own private use (let's be honest, figuring out those DNA match connections is exciting, even if it does feel a little stalky!) Most records on living people come from publicly accessible records or databases (meaning, anyone who really wants to find the information probably can). But it's still important to make sure you aren't sharing information about someone who may not want the information shared (especially minors, where you may have personal or family knowledge about key information such as full names and birthdates not yet available from other sources.)

Below are the policies from some of the most popular websites:

SITE	POLICY
Ancestry	People marked as “living” are fully visible only to the tree owner, unless the owner shares their tree with others and authorizes them to see living people (or gives them the role “editor”). To everyone else on Ancestry, living people show as “Private.” People under 100 years old are considered to be living if no death information is provided. If your tree is public, the only way to make someone private without making the whole tree private is to label them "living."
MyHeritage	Family sites at MyHeritage.com are automatically protected with privacy settings that prevent guests (non-members) from viewing sensitive information about living family members in family trees, such as first names and email addresses. They [guests] will be able to see the content that you and your site members have posted, except that your family tree will be censored (limited) so that information on living people will be hidden away. Hidden means that other than last names, no information of living people in family trees will be displayed: first names, genders, photos, dates, events, etc -- all will be hidden.
FindMyPast	Any living relatives will be marked 'private' and no details will be shown. No other user will be able to edit or change your tree in any way. Photographs and media will ONLY be shared if the additional 'Share photographs for Deceased ancestors' permission is switched on.
FamilySearch	Family Tree protects the privacy of living people by restricting who can see their records. You can see the record of a living person only if you created the record. The system hides records that you create of living people from everyone else, including the people themselves and other family members.
American Ancestors	Information about living people is always private no matter which plan you choose
Geneanet	Information about living people defined as having been alive within the past 100 years (contemporaries) are masked with the “Private” setting by default, with no information shown; you are asked to confirm this choice when you create your tree at Geneanet, or to choose one of the alternative privacy settings.
rootsfinder	Living people's data is never visible to anyone but the registered owner of the tree and those invited by that user.
GEDmatch	You agree to privatize living individuals (other than yourself) in your Genealogy Data prior to providing their Genealogy Data to GEDmatch. In order to privatize living individuals in your Genealogy Data, you must privatize Genealogy Data that contains living individuals before uploading to GEDmatch by changing the name(s) of living individual(s) to 'LIVING'... Upon an upload of a GEDcom to GEDmatch we will automatically review and change the privacy setting for the Genealogy Data of individuals in your GEDcom to “HIDDEN” if we believe such individuals are alive based on birth or death dates. The owner of a GEDcom will see the Genealogy Data of all individuals in their GEDcom that are both alive and deceased; other users will only see the Genealogy Data of deceased individuals.
FTDNA	Please note that when you select to share your family tree, living people born less than 100 years ago will not be displayed. You, deceased individuals, and individuals born more than 100 years ago will be displayed.
DNA Painter	The default option is to hide living people, replacing them with 'Living', so their details are never uploaded at all. You can optionally override this.

As you can see, most sites try to protect the privacy of living people by default, but some allow the option to override this protection based on you (the user) granting specific permissions to other users. GEDmatch has the more stringent restriction of requiring confirmation of privatization prior to upload, even though it appears they will still try to hide individuals if this hasn't been done. If you're using another site, check their policy before you upload just to be safe. And, since policies can change, reviewing periodically isn't a bad idea.

If you are an Ancestry user, please know the GEDCOM you export from Ancestry does not privatize by default. To privatize, you would need to either open the file in a text editor (such as Notepad) and edit manually or use desktop software, such as Family Tree Maker or RootsMagic, to do this for you. Depending on the size of your GEDCOM, manual editing may be less than ideal. If you use Family Tree Maker or RootsMagic, and you also privatize any facts, notes, weblinks or media, be sure you include similar privatization for these items when you export as well. You don't want to accidentally upload something to a website you never intended to become public. As we know from recent DNA breaches, anything on the web has the potential to end up in the hands of hackers. It's also wise to remember, once you post something, it's likely out there forever...even if you later delete it. Never ever upload any sensitive information or anything you, or your family members, might be horrified if it became public...especially important if the information isn't available publicly or in searchable databases (paid or free) or pertains to a minor.

While my trees are generally public (and I do have GEDCOMs uploaded to several sites), I only have 2 individuals I've allowed to see living people - and only on Ancestry where my main working tree is located. I'd suggest if you're going to allow exceptions, make it only on the site where you have your main tree. You don't want to have to remember all the various sites you may have granted different permissions if for some reason you decide to revoke access to any, or all, other users you've allowed to see living people. Privacy is a big concern, and a very legitimate one. With forethought, it doesn't have to hold you back from privatizing and reaping the benefits of more hints, more DNA matches, and the potential to break through brick walls.

Image by Tumisu from Pixabay