• Subscribe

Rescued History

Speed read
  • Text mining analysis uncovers the lost history of African-American women.
  • XSEDE's Blacklight supercomputer, HathiTrust, and JSTOR repositories aid University of Illinois researcher.
  • Researchers construct toolset to aid future digital humanities scholarship.

It is often said that history is written by the victors. But it's probably more true to say it is written by the people who have the opportunity to write.

Take, for instance, the study of black women, their lives, and their experiences. Documents recording the lives of black women are often historically obscure, squirreled away in dusty library collections, catalogued under misleading titles. Still other historical documents mention black women indirectly but may yet offer clues. Until recently, researchers had no good way of recovering this ‘lost history’ from either of these categories of documents.

Ruby Mendenhall, an associate professor at the University of Illinois at Urbana-Champaign, is leading a collaboration of social scientists, humanities scholars, and digital researchers that hopes to harness the power of high-performance computing to find and understand the historical experiences of black women by searching two massive databases of written works from the 18th through 20th centuries. The team also is developing a common toolbox to help other digital humanities projects.

"With a big data approach we get a chance to make use of hundreds of thousands of texts — journals, books, periodicals," Mendenhall says. "The number is greater than what you would normally be able to look at during an entire career."

 <strong>Harriet Tubman. </strong> Famous abolitionist, Underground Railroad leader, and women's suffrage pioneer, Tubman's life was examined by a recent digital humanities study that tapped the HathiTrust and JSTOR digital repositories and XSEDE high-performance computing resources. Courtesy H. B. Lindsley – National Portrait Gallery, Smithsonian Institution.

Powering up

Mendenhall's team realized that to search tens or even hundreds of thousands of books, articles, and letters, they'd need considerably more computing power than is available on a typical university computer cluster. They consulted with colleagues on campus who were members of the US National Science Foundation (NSF) -supported Extreme Science and Engineering Discovery Environment (XSEDE), the most advanced collection of integrated digital resources and services in the world. Those colleagues helped them identify the Blacklight supercomputer at the Pittsburgh Supercomputer Center (PSC) as a good fit for their project.

Blacklight (now retired) allowed the researchers to analyze 20,000 documents from the HathiTrust and JSTOR databases that were known to contain information about black women and to create a computational model based on this corpus. They are now using this model to study the entire 800,000 documents in both databases.

Words translated into numbers, graphics

To make sense of the huge datasets, the investigators turned to two sets of computational techniques: Topic modeling and data visualization.

Topic modeling looks at how often certain keywords appear in connection with other terms. For example, a book that contains the word ‘negro’ – at the time considered the most respectful term to describe black men and women – the word ‘vote’ and the word ‘women’ might offer clues about black women's participation in the women's suffrage movement. Mike Black, formerly at the University of Illinois and currently at the University of Massachusetts, headed the team's topic modeling project.

"We're hoping, in the next stage, to ramp up and check these topics against the larger corpus of works," Mendenhall adds.

Mark Van Moer, an XSEDE staff member at the University of Illinois's National Center for Supercomputing Applications, worked as the team's visualization specialist.

<strong>Words of a feather. </strong> A cluster of concepts spanning labor, employment, and industry illustrates correlating topics. Courtesy Ruby Mendenhall, University of Illinois Urbana-Champaign.

As part of the project, he built ways of displaying results to make more intuitive sense of the data. For instance, a ‘tree map’ displays key words in boxes corresponding to each word's frequency, whereas a ‘network graph’ charts how often keywords appear close to each other, also offering insight into how those words are being used and what they mean in context. Yet another visualization technique plots key terms in histographs that allow users to track the emergence and prominence of a given topic over time.

Making sense of the numbers

One aspect of the research involved explorations of the post-World War I Black Women's Club and the New Negro movement. A keyword search revealed that many of the documents that referenced one topic also referenced the other, confirming Mendenhall's prediction that these historical activities were linked. The finding raises interesting questions about how the two movements, which historians knew were contemporaneous, may have interacted. The Illinois researchers hope to begin answering these questions in their ongoing work at PSC, as well as their proposed work on Bridges, an NSF-funded supercomputer coming online later this year.

"The beauty of computation and big data lies in how it complements traditional close reading," says Nicole Brown, a postdoctoral fellow in Mendenhall's group who is interpreting the computational results in light of black feminist theory. "The two methods complement each other to give you a full picture of what's going on."

Van Moer adds that working with social science and humanities researchers "has been a real eye opener in a lot of ways. Humanities and social science researchers have to be worried about not just what the numbers mean at a surface level. They have a whole theory behind how you go about interpreting things as they relate to the larger society – that's really an interesting aspect of the project for me."

Another group goal is to create a set of computational tools that researchers in many fields can use to help search texts for topics of interest – and to understand how those topics interrelate. Topic modeling and visualization methods can be modules in a larger toolbox for digital humanities research.

"We're generally interested in black women and their life experience," Mendenhall says. "But we also see this as a tool that social scientists and people in the humanities can use to study many topics."

Join the conversation

Do you have story ideas or something to contribute? Let us know!

Copyright © 2021 Science Node ™  |  Privacy Notice  |  Sitemap

Disclaimer: While Science Node ™ does its best to provide complete and up-to-date information, it does not warrant that the information is error-free and disclaims all liability with respect to results from the use of the information.


We encourage you to republish this article online and in print, it’s free under our creative commons attribution license, but please follow some simple guidelines:
  1. You have to credit our authors.
  2. You have to credit ScienceNode.org — where possible include our logo with a link back to the original article.
  3. You can simply run the first few lines of the article and then add: “Read the full article on ScienceNode.org” containing a link back to the original article.
  4. The easiest way to get the article on your site is to embed the code below.