Category: arXiv development

Our recent outage

You may have noticed that arXiv was mostly unavailable for several hours on March 26, ultimately leading us to postponing the mailing for that evening. First, please accept our apology for this major service disruption; we know that many of you rely on arXiv as part of your daily workflows. As our second major service…Continue Reading Our recent outage

Planning, prioritization, and getting things done in arXiv-NG

The arXiv Next Generation project is an ambitious effort to renew the software that runs arXiv.org for long-term evolvability. In a previous post, I described some of the technical drivers for arXiv-NG, and our high-level approach. We’ve embarked on a mission to progressively rebuild the arXiv software by isolating components from the classic system, and…Continue Reading Planning, prioritization, and getting things done in arXiv-NG

Engaging external developers in arXiv-NG

Starting last June, the arXiv team began reaching out to researchers and developers who have created tools that leverage arXiv APIs and/or content. We identified several hundred projects on GitHub and SourceForge, as well as platforms mentioned in responses to the 2016 arXiv user survey. We conducted a targeted survey for API consumers, and contacted…Continue Reading Engaging external developers in arXiv-NG

arXiv Technical Evaluation Rubric

While we eventually decided to adopt an incremental, microservices-based approach to redeveloping arXiv (see the post arXiv NG: Classic Renewal for context), we did spend considerable time evaluating existing repository technologies. To that end, we developed a technical evaluation rubric that we applied to candidate technologies, and are pleased to share that here in case…Continue Reading arXiv Technical Evaluation Rubric

Visit to Astrophysics Data System

ADS (Astrophysics Data System) held its second ADS Users Group meeting on 2–3 November. In advance of the meeting, on 1 November I spent the day meeting with Alberto Accomazzi (ADS PI), Michael Kurtz (Project Scientist), Edwin Henneken (IT Specialist), and members of the ADS development team. The ADS Digital Library was founded in the…Continue Reading Visit to Astrophysics Data System

arXiv NG: Classic Renewal

To paraphrase an observation by our new Scientific Director: from the perspective of most of our users, arXiv runs on magic. With the exception of a small handful of hiccups, arXiv has just worked for over 25 years. Since I joined the arXiv IT team as lead software architect in June, I’ve been working hard…Continue Reading arXiv NG: Classic Renewal

Development update: reference extraction & linking

Based on user and stakeholder feedback, extracting cited references from arXiv papers and providing links to those references for readers was identified for development under the 2017 arXiv Roadmap, based on input from the arXiv user survey. We have also heard from our API consumers that access to cited references would be valuable. arXiv already detects arXiv…Continue Reading Development update: reference extraction & linking

Another quick arXiv user poll (links to publications cited by articles in arXiv)

We are considering enhancements to display links that will take the reader to the papers cited in arXiv articles. We already add arXiv links to PDFs when the TeX source is available and arXiv ids are present, for example. We would like your input on extending this further: https://cornell.qualtrics.com/jfe/form/SV_aXm93JtLfXmg9Mh The survey will remain open until…Continue Reading Another quick arXiv user poll (links to publications cited by articles in arXiv)

Our first arXiv-nextgen user poll!

We’re pleased to be conducting our first arXiv-nextgen user poll. The arXiv team is working on extracting and presenting article references on the abstract page. We’d like to know how you’d like them to be presented to you. You can express your preference by taking a very short survey: https://cornell.qualtrics.com/jfe/form/SV_cCmPDAqvlgadsln. The survey will be available until…Continue Reading Our first arXiv-nextgen user poll!