Acceptance Numbers

The notifications for acceptances have been sent out on March 5th. Congratulations to all who will be joining us in August. Thank you to the Program Committee members who have taken the time and energy to make difficult decisions during what we are calling, the Secondary Review process.

We received a large number of proposals (543) of excellent quality. The acceptance scores are as follows:
– Long Papers: 94 of 152 submissions accepted (61%)
– Short Papers: 120 of 214 submissions accepted (56%)
– Posters: 77 of 112 submissions accepted (69%)
– Panels: 28 of 40 submissions accepted (70%)
– Workshops: 15 of 22 submissions accepted (68%)
The overall acceptance rate (across all submission formats) is 72%.

 

highest accept score, lowest accept score, highest reject scoreand lowest reject score for accepted long paper
short paper, panel, poster, workshops, mini-conference sessions
Image Credits: Dr. Andy Janco

 

One of the most important tasks of the PC is to make a determination to accept or reject submissions where reviewers have differing opinions. This document outlines our approach to this important task and documents our processes.

In line with Alex Wermer-Colan’s work and Roopika Risam’s documentation for ACH Conference, we aimed to conduct manual qualitative analysis of each of the reviews in January-February before we come to a final list for accepted submissions. The review response phase is not in the timeline of events this time around, in favor of the qualitative analysis of reviews approach. We want to be mindful of the labor that reviewers are volunteering for the DH community, as we deliberate on the acceptances. The number of submissions’ reviews to be evaluated also was manageable since it is back to the scale of the pre-pandemic conference this year (https://dh2024.adho.org/dh2024-submissions/)

The intention with the Secondary review process was to exert qualitative as well as quantitative evaluation of the reviews. Conftool allows for sorting by the average of the points given for each submission, as well as the consensus span score that indicates the differing opinions between reviewers. While this was the jumping off point for the higher level view of the submissions, the PC was asked to go through a number of submissions by reviews each. Similar to the review process, we tried our best to match the multilingual secondary reviews for the submissions with PCs who were knowledgeable of the language and the subject matter as much as possible. Submissions which did not have abstracts, file uploads, or incomplete information were filtered out of this process. These were often in the lower bound (red) in the sorting. PC decisions were especially important for the submissions placed in the middle in the yellow. The steps included making note of the new review criteria, submission type, and making comments on the Conftool Online Forum for the Program Committee. We developed a vocabulary for evaluating reviews in Subject Header of Online Forum Board:

  • AGREE WITH (AW)
  • DISQUALIFIED (DQ)
  • TIE-BREAKING (TB)
  1. When reviewer gives informed opinion and PC member agrees with that opinion: Agree with Thoughtful Reviewer identified by their Reviewer Number
  2. When a reviewer does not provide enough information to be a valid review: Disqualified review
  3. When a reviewer is overly critical to a disproportionate degree: Disqualified review
  4. When all reviewers’ reviews are disqualified: PC Reviews
  5. When 2 reviewers vs 1 reviewer: Tie-breaker
  6. When reviews are not clear in the content of their review: PC goes in reviews the submission itself & makes a decision

For example:

Dr. Andrew Janco has created a new message to contribution ###: "DH Submission ###"
Created at: 30th Jan 2024, 08:40:52am
Vote: Maybe reject
AW 1,2; TB 29-70
Review 3 overly-generous, 4 critical, 1+2 note lack of specifics

—————-

Acceptance numbers

The image is a table that summarizes the submissions to a conference. It shows the number of submissions, the number of reviews assigned, the number of reviews completed, and the number of submissions that were accepted, rejected, or changed format. The table also shows the percentage of submissions that were accepted or rejected.

A note to those who received rejections: It is always unpleasant to receive notes on our work. We recognize that peer review is a hard process. We appreciate you sharing your work with the Digital Humanities community. While we’re unable to change decisions, we highly encourage you to submit to ACH and / or submit again in the future, making note of your specific considerations.

January Report

Thanks to everyone who participated in our peer review process this winter.

The DH2024 Program Committee would like to thank the 585 volunteers who wrote reviews. This work is essential to the success of the conference. Without your input, we could not create the conference program.

Each submission was assigned an average of four reviewers. The highest score was 98.7, and the lowest was 0. The average score was 75.

Please keep in mind that we are not using the scores alone to determine the acceptance or rejection of a submission. We are currently starting the qualitative process of reviewing the reviews.  Notifications of acceptance will be sent on March 5th.

We’re also excited to announce the official registration rates for DH 2024.

Online Early Bird On-Site Regular On-Site
ADHO member $100 $225 $325
non-ADHO member $150 $325 $425
ADHO student $50 $100 $150
non-ADHO student $75 $125 $175

Early bird registration will open in mid March and run until May 15th.

Regular registration will be open until July 15th.

Anyone who originally registers for on-site attendance, but later needs to switch their registration to online attendance, may do so and receive a refund of the difference in registration rates up to July 15th.

If you need a letter of invitation, please email us at dh2024@gmu.edu with your name as you wish it to appear in the letter and will we send you one promptly.

Thank you again to everyone who submitted proposals or helped in the peer review process. The Program Committee is now deliberating on the program and we look forward to seeing the results of all your hard work.

Reviewing Guidelines and Recommendations

These recommendations are based on the “Handreichung für den Begutachtungsprozess der DHd-Jahrestagungenprepared by Manuel Burghardt, Lisa Dieckmann, Svenja Guhr, Nils Reiter, Walter Scholger, Timo Steyer, Peer Trilcke, Ulrike Wuttke on behalf of DHd (Digital Humanities in the German-speaking area), and were expanded and adjusted by Anne Baillot, Walter Scholger and Toma Tasovac. [Download PDF]

1. General recommendations for reviewers

  • Before accepting the review, please consider potential conflicts of interest or biases that may hinder your partiality.
  • Read the expanded review criteria (see below) in full and use them as the basis for your evaluation. Please make the relationship between the score (number of points you are giving) and the criteria this score is based on as explicit as possible.
  • Please provide constructive feedback that clearly points out existing weaknesses to the authors and offers concrete suggestions for improvement.
  • Refrain from belittling or derogatory formulations in your review. The review should critically evaluate the submission, but always be constructive in tone.
  • If you have objections to the writing style, cite specific examples/the passages in question.
  • Even if you personally disagree with basic premises of the submission, please critically question whether rejection of the same can be justified with objective arguments. Likewise, please do not reject a submission simply because you are not personally interested in the relevant subject area, but rather make use of the option to decline review in such cases.
  • Please provide appropriate feedback on contributions for which you have no critical comments. In such cases, emphasize the particular strengths of the contribution.
  • The focus of the review is the contribution. Especially in the case of early career scholars, you may consider their disciplinary and academic background.
  • Personal and/or political opinions expressed by authors (e.g., on social media) are not part of the review process and should not be considered.
  • Reviewers should reflect on their own potential unconscious biases and, as much as possible, exclude them from the review process.

2. Bias criteria for declining review

Please check the following list of bias criteria thoroughly before accepting any review as well as when conducting a review. Criteria A to C should lead to declining a review. In the case of criteria D to F, you as the reviewer should make a decision on a case-by-case basis.
This list does not cover all bias scenarios. Each reviewer is encouraged to thoroughly and conscientiously reflect upon their own biases regarding a submission and, when in doubt, decline to review.

Exclusion criteria

A. Close relationships: first-degree relationships such as close family, marriage, civil partnership, romantic partners, etc.
B. Existing or planned collaboration: current or planned close scientific collaboration, e.g. joint publications, joint project implementation.
C. Existing, imminent, or recent professional hierarchical relationship: official subordination or a supervisory relationship up to three years after termination of the relationship, as well as imminent or planned official dependence or supervisory relationship (from teacher-student relationship up to and including the postdoc phase).

Case-by-case decision

D. Past close cooperation: significant scientific cooperation within the last 1.5 years, e.g. joint publications, joint project realization.
E. Competition: preparation of a proposal or implementation of a project on a closely related research topic.
F. Distant kinship or other close personal relationship: kinship relationships that do not fall under A), other personal ties or conflicts.

Review Criteria

As you prepare your proposals, you are welcome to check the review criteria here: https://adho.org/wp-content/uploads/2023/10/ADHO_conference_evaluation_criteria.pdf

Further explanation of the revised ADHO review criteria can be found here: https://adho.org/2023/12/18/a-brief-explanation-of-the-revised-adho-conference-review-criteria/

DH2024 Submissions

With the submission deadline past (thank you to everyone who submitted!), we get a fascinating glimpse of our field by looking at all the proposals for the DH2024 conference. So following Scott Weingart’s example, we wanted to share a snapshot of the data.

There were a total of 545 submissions this year.

DH2024 submissions plot by type of presentation.

The majority of submissions were in English. However, there are many in Spanish, French, and German.

84% plan to attend in person in Washington, DC.  16% plan to attend virtually.

There were 80 requests for technical review. Thank you to DHTech for requesting this new initiative to match proposals with reviewers who have technical expertise.

 

Top 25 keywords. 'pedagogy machine learning natural language processing text analysis network analysis text mining digital history visualization accessibility infrastructure history ontology artificial intelligence digitization digital publishing social network analysis nlp named entity recognition computational literary studies ai collaboration archives linked open data annotation computer vision'

Topic modeling of the abstracts shows three main topics of interest. This is subjective, but I’d call them Global DH,  Archives & History, and Literature.

Topic modeling of abstracts

 

And when did everyone send in their proposals?

Plot by day of submission, with majority on the last day

 

 

November/December Update

This is a preview of the longer Nov/Dec update that will come next week, but we wanted to make sure everyone heard the good news that the CFP deadline was extended to Sunday, December 10th, 11:59pm EST! Review assignments will still go out circa December 18th.

Check back here for more information on the reviewing process and conference updates next week.

October Report

We’re thrilled to announce that the Call for Proposals (CFP) is live on our website.  You can access it as an HTML webpage or a downloadable PDF in

We want to thank the Program Committee (PC), especially PC Chairs Andrew Janco & Jajwalya Karajgikar, for all their hard work on the CFP. We’re all excited to build on the work of DH2023 and bring you ADHO’s first intentionally hybrid conference. You can present your work onsite or online, as well as try out our experimental “flipped” format where you pre-record your presentations as videos that other attendees watch before the conference, enabling you to use all of your synchronous time for Q&A and live discussion.

You will notice the CFP does not indicate a conference language. There is no official language of the United States, although English is currently our dominant language. In that same spirit, there will not be an official language of DH2024, though we recognize that English is currently the dominant language of our international DH community. We welcome both proposals and presentations in any of the official ADHO languages of English, French, German, Italian, and Spanish. We also would like to take this moment to thank the people named at the bottom of the various CFPs for their translation efforts.

ConfTool will open for proposal submissions on November 1st and the deadline for submissions is December 5th. After that point, we will need reviewers! A call has already gone out to past reviewers so please check your spam filters and sign up to review.

ADHO has revised its Code of Conduct to cover all aspects of DH2024, including online conference activities. This means reviewing activities will be subject to the ADHO Code of Conduct. The expanded Code of Conduct will be available at https://adho.org/code-of-conduct/ by December 1st.

And last but never least, we’re looking for keynote nominations! We would love it if the keynotes could speak to the conference theme of “Reinvention and Responsibility.” In keeping with our hybrid modality, speakers can be onsite or online, so feel free to nominate people who would make great speakers even if they can’t travel. The PC is accepting nominations at http://bit.ly/dh24-keynote