Text Analysis with Voyant

Textmining allows you to use computer software to conduct an extensive quanitative analysis of text. Textmining is most useful in conducting an analysis of large corpora in a database or archive. Specifically, textmining can be used to search through text to quanitify how often a certain word appears in a digitized archive or material. Textmining tools can be used to examine patterns or trends in qualitiative data. Several projects that have utilized textmining include America’s Public Bible, Robots Reading Vogue and Signs40.  In the case of America’s Public Bible, textmining was used to perform an analysis of biblical quotations in US newspapers to determine trends in biblical references at different historical periods. Robots Reading Vogue was designed to evaluate beauty trends over time while Signs40 used textmining to determine changes in Signs’ feminist scholarship. Trends related to certain words, topics and themes can then enable a researcher to draw certain conclusions on the historical time period of study.

Free text mining tools like Voyant can be used to conduct textual analysis. For instance, you can upload links of textual information to Voyant as a dataset that will then be processed into a digital corpus. From there,  tools like Cirrus, Reader, Trends, Summary and Contexts can be used as visual interactives to find patterns or differences in the data. The dataset used for my exploration of Voyant was the WPA Slave Narratives.

I utilized all of Voyant’s given tools to compare the frequency of words in various states. Specifically, I compared the states of Alabama and Maryland to each other by seeing the distinctive words utilized in their interviews.  For instance, Alabama used distinct words like  didn’t (357), alabama (138), ain’t (213), don’t 182), ca’se (69), caze(104), couldn’t (103), i’s (93), i’se (92), dat’s (90). Maryland used distinct words like  bowie site. (17), baltimore (64), ellicott(11), cockeysville (11), arundel (9), annapolis (9), md (11), maryland (60), rezin(7), manor (6). From this analysis, I was able to conclude that Alabama’s distinct words referred to their unique dialect while Maryland’s distinct words referred to Maryland African American communities. In using Voyant, I was able to see that while textmining is useful in searching through large sets of data-it is imperative that a person is working in conjuction with the software to get rid of unnesessary “stop” words and to make sense of the words that are repeated throughout to draw historical conclusions.

 

Why Metadata Matters

Metadata is “structured textual information that describes something about the creation, content or context of a digital resource” (Jisc, 2014). Metadata enables items to be discoverable in a database or archive due to the field information provided. Researchers, patrons and digital humanists can use the metadata provided in common fields like title, subject, description, creator, date, format, type and location to find artifacts and documents.The common fields present digital humanists with a source’s context and descriptive infromation. Context and description are the most essential parts of metadata as they help digital humanists understand “the physical and digital origin, structure, and technical makeup” of a resource (Carbajal and Caswell, 2021, pg.1108 ). From this, digital humanists can improve their own understanding of their research and appropriately utilize primary and secondary sources in the digital humanities.

Additionally, metadata serves a purpose in maintaining an archive’s material infrastructure which can then aid the digital humanities as a whole. Maintaining infrastructure through the preservation of physical and digital records will feed into the ever changing architectural, technological, social, epistemolgical, and ethical structures of an archive (Carbajal & Caswell, 2021). Consequently, digital archivists can fullfill the needs of their digital users by adopting improved metadata standards to extinguish problematic metadata. The continued maintenance of material infrastructure has the power to place checks on the political, historical, and cultural biases of the archivist or archive in order to better satisfy the needs of a diverse population of digital users.

Tropy and Omeka can assist digital humanities practitioners in research organization and collaboration. Trophy is a software tool and unified system that enables researchers to manage and describe the image files of archival materials. Archival photographs can be saved and viewed for future reference within Tropy.  Specifically, common field information for resources can be saved within the software and organized into various projects and collections. Similarly, Omeka serves as a computer software that assists researchers in organizing their materials. Omeka also has interoperability which allows users to share Tropy’s archival metadata with a larger audience. For instance, I am now able to share my findings related to Service Guardian and Hamilton Beach cookware. Software like Tropy and Omeka enabled me to become more thorough with locating and writing the correct metadata. Since Omeka is a resource that can be shared with others, I wanted to make sure that I was using the correct subject, name, title, and name authorities for my kitchen collection. I also wanted to develop enough accurate background knowledge on my kitchen items to provide the correct contextual and descriptive information. Fortunately, Tropy and Omeka enable users to follow the best practices in maintaining metadata by offering archival organization and information sharing. 

Market Research and American Business, 1935-1965 Database Review

Market Research & American Business, 1935-1965 Review

Market Research & American Business , 1935-1965 is a database that showcases original documents in the pursuit of knowledge related to the consumer boom of the mid-20th century.

Search

The site is researcher friendly as it provides a chronology, pop up glossary, an ad gallery and a “My Archive” feature. The chronology is related to mid-20th century consumerism, covering a timeline of 100 years. The site prides itself on its chronology tool even going so far as to state that its patrons can “view entries specific to a range of thematic categories, such as Inventions and Innovations, and Businesses and Brands.” The site also specifies that it is possible to search the database via keywords and then “create a printable list of the entries most relevant to your research.” The chronology tool provides its patrons with a list view option, histogram, navigation arrows, and filter options with category and timeline tabs. The pop up glossary allows users to define terms related to advertising, marketing, and market research. The ad gallery is a collection of advertising prints from the 1930s-1960s that can be filtered by Industry, Decade, Image Type, or Brand, and the companies. Researchers can also save their newly discovered resources in the “My Archive” feature of the site to revisit at a later time.

In regards to documents, they are filtered by type. Documents can be filtered as Letters, Memorandums, Pilot Studies, Proposals, Reports and Supporting Materials. All documents are assigned an industry in which they are associated. Industries are listed alphabetically and include Advertising, Electronics, Food and Drink and much more. Search directories are provided that enable keywords, companies and brands to be used in research. Original images can be viewed using the image viewing screen and by utilizing the magnification tools. The search engine “searches across all document-level metadata including bibliographic details, full text of printed material and selected additional editorial features.” The search engine can carry out a keyword search and a more advanced search. Further resources are also provided such as case studies, essays, and business biographies.

Date Range: 1935-1965

Publisher: Adam Matthew

Object Type: Documents and Images

Exportable Image: Yes

Facsimile Image: Yes

Full Text Searchable: Yes

History/Provenance:

The market research reports of Ernest Dichter, the most prominent consumer analyst and researcher of the time, are a pivotal part of the archive. Additionally, the database has collected an abundance of reports related to consumerism and the advertising industry of the historical time frame. Adam Matthew Digital Ltd is the publisher of the material while participating libraries include Hagley Museum and Library, Ernest Dichter and the Institute for Motivational Research, John W. Hartman Center for Sales, Advertising & Marketing History (Duke University), and the Advertising Archives.

Reviews:
“This file delivers amply on the vendor’s claim that it “provides a unique insight into the world of buying, selling, and advertising in pre- and post-war America.” It does more than that, with sometimes chilling psychosocial analysis that will successfully serve researchers in the areas of psychology, history, business, marketing, advertising, consumerism, gender studies, ethnic and minority studies, communications, sociology, American studies, philosophy, terrorism, and politics.” – Cheryl LaGuardia, Library Journal

“The vintage images match the aesthetic of the twentieth-century era. This database was visually enjoyable and informative for those who are interested in studying twentieth-century market trends, as well as some of the psychological motivations and behaviors of this era. The topics of reports range in product types and behaviors.”
-Anne Larrivee, Reference Reviews

Access: Requires an institutional login to access the database.

Info from Publisher: www.amdigital.co.uk

Other Info:
Images and documents can be downloaded as PDFs, printed, and photocopied. Additionally, digital items can be bookmarked and shared. That said, materials are restricted by copyright as long as items are not duplicated or used for profit but educational purposes. The site also states “none of the material may be published without first gaining permission from Adam Matthew and The Hagley Library.”

Citing:
According to Market Research and American Business, 1935-1965 database, scholars should follow the correct parameters for citation. Scholars should reference the document or image and the library holding the material. The copyright notice should be referenced. The bibliographic details of documents can be exported to RefWorks and EndNote.

 

 

A Guide to Digitization

Digitization can only go so far in capturing all that an artifact has to offer so it is important to consider the “digitization, rendering and meaning behind a re-presentation” of an image (Conway). To a certain extent, digitization can capture the color, size, shape, sound and texture of an item. Digitization is mostly dependent on the type of digitization that is used to archive an item. Videography works well in capturing the sound of an item, size, color, and texture to offer a more dynamic visual experience. In comparison, photography works well for capturing a “simplistic” image of an artifact. However, photographs can be dynamic in their scope as there are many decisions relating to spatial resolution, tone reproduction and color space. More than one photo of an item may be needed to capture more of what an artifact has to offer. Thus, multiple photographs or a collection can capture more characteristics related to the size, shape and color of an image. As stated by Paul Conway, “building collections of photographs through digitization is fundamentally a process of representation” which is then without a doubt a “far more interesting and complex than merely copying them to another medium.”  However, more than one form of digitization may be needed to capture all the characteristics an artifact has to offer. Meaning is a very important aspect of digitization and one form of digitization may place limitations on the intentions behind a visual image. According to Melissa Terras, digitization is quite “commonplace in most memory institutions, such as libraries, archives, and museums” which means digitization will only grow more and more popular as time goes on. Consequently, multiple approaches to digitization are needed in order to enable artifacts to serve educational and artistic purposes that preserve the digitized cultural heritage.

Government Publication Office (GPO) Resource

The Government Publication Office (GPO) is a resource that can be used to view works that are created by agencies in the United States Government. Their terms of service are the following. The site houses publications from all three branches of the Federal Government. The site focuses on public access, content management and the digital preservation of government documents. They have collections of Bills and Statutes, Budget and Presidential materials, Congressional Committe materials, Executive Agency publications, Judicial Publications, Proceedings of Congress and General Congressional Publications and so on.

Unsplash Resource

Unsplash is a great site to use for public domain images. Their terms of service are as follows. Accordingly, Unsplash advertises itself as a location that houses freely usable images. It first began as a Tumblr blog and it has now evolved into a site that houses over 3 million images. Unsplash’s license also states that all photos can be downloaded and used for free. They can be utilized for commercial and non-commercial purposes and no permission is needed but they would appreciate attribution. Additionally, Unsplash has many  images curated for educational purposes.

The Library of Congress Resource

The Library of Congress has always been a great research tool. Terms of use for the site are as follows.

The Library’s mission is “to engage, inspire, and inform Congress and the American people with a universal and enduring source of knowledge and creativity.” The United States’ Library of Congress has a vast digital collection that includes various formats of media. These formats include audio and video recordings, books/printed materials, film, video, legislation, manuscripts, maps, notated music, newspapers, personal narratives, photos, drawings, software, web archives, and 3D objects. The site also includes plenty of educational resources that can be used to engage students. These materials include classroom materials like lesson plans that utilize primary sources.

The Prelinger Archives Resource

The Prelinger Archives is another great resource for those in pursuit of the Digital Humanities.  The Prelinger Archives are situated within the Internet Archive. Their terms of service are as follows.

The site itself is dedicated to archiving films. These films from being educational, industrial, amateur and commercial. The mission of the archive is to “collect, preserve, and facilitate access to films of historic significance that haven’t been collected elsewhere.” The archive has a vast collection of digitized and videotaped files. The collection includes public domain material based on the terms of the Creative Commons Public Domain license. Items in the archive are free for download and reuse.

NASA on The Commons Resource

I am still currently searching for more sites that cater to public domain and creative commons materials. I have most recently stopped at the NASA Commons site on Flickr. The terms of and conditions of Flickr are available here. The purpose of this site is to give public access to the National Aeronautics and Space Administration’s collection of photographs, historic film, and video. Consequently, this enables NASA’s mission to “pioneer the future in space exploration, scientific discovery and aeronautics research” to flourish. The site was created in November 2009. It has a total of 251 million views and 26.3 K followers. Currently, 3,393 photos have been posted to NASA on The Commons.

 

J Paul Getty Museum Resource

 

I recently came across the J. Paul Getty Museum, as an online source for public domain materials. The site is available here. As per rule of thumb, I made sure to check their site’s rights statement.  The site provides access to the collections of the Getty Research Institute. The collections include digital images of photographs and oral histories. These are mostly related to art history. Getty also grants access to its virtual libraries for books , publications and research collections. The J. Paul Getty Museum also provides teaching resources such as lesson plans, curriculum resources and activities for students.

Digital humanities issues, tools, and resources