_re_id["doi"] = re.compile(r"\b10\.\d{4,}(?:\.\d+)*\/(?:(?!['\"&<>])\S)+\b") _re_id["bibcode"] = re.compile(r"\b\d{4}\D\S{13}[A-Z.:]\b") _re_id["arxiv"] = re.compile(r"\b(?:\d{4}\.\d{4,5}|[a-z-]+(?:\.[A-Za-z-]+)?\/\d{7})\b")

birnstiel commented on Mar 17, 2015 Thanks! The export script only returns the bibcodes, not the full entries. Is there a way to query all those bib codes? The ADS 2.0 search seems to support only one bibcode: search.

Solarsoft IDL

NOTE: the query part of URL (i.e., after "query?") is restricted to 1000 characters. This effectively limits the number of bibcodes you can specify in one query to about 40. The ADS API webpage mentions a "bigquery" alternative option, but I couldn't get this to work.

https://api.adsabs.harvard.edu/v1/search/query?bibcode=2015ApJ...799..218Y&fl=title However, it's necessary to specify your ADS key for this to work. With the Unix curl command, the query is: curl -H "Authorization: Bearer [KEY GOES HERE]" \\ "https://api.adsabs.harvard.edu/v1/search/query?bibcode=2015ApJ...799..218Y&fl=title"

APIs for Scholarly Resources What is an API? API stands for application programming interface. An API is a protocol that allows a user to query a resource and retrieve and download data in a machine-readable format.  Researchers sometimes use APIs to download collections of texts, such as scholarly journal articles, so they can perform automated text mining on the corpus they've downloaded. Here is a simple tutorial that explains what an API is.  Below are some APIs that are available to researchers. Some are open to the public, while others are available according to the terms of Temple University Libraries' subscriptions. Many require you to create an API key, which is a quick and free process.   How do I Use APIs? You can create a simple query in the address bar in a web browser. However, a more complex query generally requires using a programming language. Commonly used languages for querying APIs are Python and R. (R is the language used in the R software.) The examples given in the documentation for the APIs listed below typically do not include sample programming code; they only explain how the data is structured in order to help users write a query. List of APIs for Scholarly Research arXiv Content: metadata and article abstracts for the e-prints hosted on arXiv.org Permissions: no registration required Limitations: no more than 4 requests per second Contact: https://groups.google.com/forum/#!forum/arxiv-api, https://arxiv.org/help/api/index   Astrophysics Data System Content: bibliographic data on astronomy and physics publications from SAO/NASA astrophysics databases Permissions: free to register; request a key at https://github.com/adsabs/adsabs-dev-api Limitations: varies Contact: https://groups.google.com/forum/#!forum/adsabs-dev-api, adshelp@cfa.harvard.edu   BioMed Central Content: metadata and full-text content for open access journals published in BioMed Central Permissions: free to access, request a key at https://dev.springer.com/signup Limitations: none Contact: info@biomedcentral.com   Chronicling America Content: digitized newspapers from 1789-1963, as well as a directory of newspapers published 1960 to the present, with information on library holdings Permissions: no registration required Limitations: none Contact: http://www.loc.gov/rr/askalib/ask-webcomments.html   CORE Content: metadata and full-text of over 100 million OA research papers Permissions: free to access for non-commercial purposes, request a key at https://core.ac.uk/api-keys/register Limitations: One batch request or five single requests every 10 seconds. Contact CORE if you need a faster rate. Contact: theteam@core.ac.uk   CrossRef Content: metadata records with CrossRef DOIs, over 100 million scholarly works Permissions: no registration required Limitations: guidelines to avoid overloading the servers at https://github.com/CrossRef/rest-api-doc#meta. "We reserve the right to impose rate limits and/or to block clients that are disrupting the public service." Contact: labs@crossref.org   Digital Public Library of America Content: metadata on items and collections indexed by the DPLA Permissions: request a free key; instructions here https://pro.dp.la/developers/policies Limitations: none, however, "The DPLA reserves the right to limit or revoke access to the API if, in its discretion, a user engages in abusive conduct, conduct that materially degrades the ability of other users to query the API." Contact: codex@dp.la   Elsevier Content: multiple APIs for full-text books and journals from ScienceDirect and citation data from Engineering Village and Embase Permissions: free to register; click 'Get API Key" to request a personal key: https://dev.elsevier.com/ Limitations: "Researchers at subscribing academic institutions can text mine subscribed full-text ScienceDirect content via the Elsevier APIs for non-commercial purposes."   Usage policies depend on use cases; see list at https://dev.elsevier.com/use_cases.html Contact: integrationsupport@elsevier.com   HathiTrust (Bibliographic API) Content: bibliographic and rights information for items in the HathiTrust Digital Library Permissions: no registration required Limitations: may request up to 20 records at once. Not intended for bulk retrieval Contact: feedback@issues.hathitrust.org   HathiTrust (Data API) Content: full-text of HathiTrust and Google digitized texts of public domain works Permissions: free to access, request a key at https://babel.hathitrust.org/cgi/kgs/request Limitations: "Please contact [HathiTrust] to determine the suitability of the API for intended uses." Contact: feedback@issues.hathitrust.org   IEEE Xplore Content: metadata for articles included in IEEE Xplore Permissions: must be affiliated with an institution that subscribes to IEEE Xplore. Temple is a subscriber. Limitations: maximum 1,000 results per query Contact: onlinesupport@ieee.org   JSTOR Content: full-text articles from JSTOR Permissions:  free to use, register at https://www.jstor.org/dfr/ Limitations:  Not a true API, but allows users to construct a search and then download the results as a dataset for text-mining purposes. Can download up to 25,000 documents. Largest datasets available by special request Contact: https://support.jstor.org/hc/en-us   National Library of Medicine Content: 60 separate APIs for accessing various NLM databases, including PubMed Central, ToxNet, and ClinicalTrials.gov. The PubMed API is listed separately below. Permissions: varies Limitations: varies Contact: varies   Nature.com OpenSearch Content: bibliographic data for content hosted on Nature.com, including news stories, research articles and citations Permissions: free to access Limitations: varies Contact: interfaces@nature.com   OECD Content: a selection of the top used datasets covering data for OECD countries and selected non-member economies. Datasets included appear in the catalogue of OECD databases with API access Permissions: no registration required, see terms and conditions Limitations: max 1,000,000 results per query, max URL length of 1,000 characters. Contact: OECDdotStat@oecd.org   PLOS Search API Content: full-text of research articles in PLOS journals Permissions: free to access, register at http://api.plos.org/registration/ <!--td {border: 1px solid #ccc;}br {mso-data-placement:same-cell;}--> Limitations: Max is 7200 requests a day, 300 per hour, 10 per minute. Users should wait 5 seconds for each query to return results. Requests should not return more than 100 rows. High-volume users should contact api@plos.org. API users are limited to no more than five concurrent connections from a single IP address. Contact: api@plos.org   PubMed Content: information stored in 38 NCBI databases, including some info from PubMed. Will retrieve a PubMed ID when citation information is input. Permissions: API key required starting May 1, 2018 Limitations: After May 1, 2018, with an API key a site can post up to 10 requests per second by default. Large jobs should be limited to outside 9-5 weekday hours. Higher rates are available by request (see contact information below) Contact: eutilities@ncbi.nlm.nih.gov <!--td {border: 1px solid #ccc;}br {mso-data-placement:same-cell;}--> ​   Springer Content: full-text of SpringerOpen journal content and BioMed Central, as well as metadata from other Springer resources <!--td {border: 1px solid #ccc;}br {mso-data-placement:same-cell;}--> Permissions: free to access, request a key at https://dev.springer.com/signup Limitations: noncommercial use Contact: tdm@springernature.com   World Bank APIs Content: APIs for the following datasets: Indicators (time series data), Projects (data on the World Bank’s operations), and World Bank financial data (World Bank Finances API) Permissions: no registration required Limitations: See Terms & Conditions of Using our Site Contact: data@worldbankgroup.org        Acknowledgements We would like to acknowledge API guides created by the Libraries at MIT, Berkeley, Purdue and Drexel that informed our work on this guide. Librarian Gretchen Sneff I'm offline, chat with another librarian jQuery.getScript("https://api3.libcal.com/js/myscheduler.min.js", function() { jQuery("#mysched_8635").LibCalMySched({iid: 1621, lid: 0, gid: 0, uid: 8635, width: 500, height: 450, title: 'Schedule an Appointment with a Librarian - ', domain: 'https://api3.libcal.com'}); }); Schedule Appointment #mysched_8635 { background: #2A609A; border: 1px solid #2A609A; border-radius: 4px; color: #FFFFFF; font: 14px Arial, Helvetica, Verdana; padding: 8px 20px; cursor: pointer; } #mysched_8635:hover, #mysched_8635:active, #mysched_8635:focus { opacity: 0.6; } Contact: gsneff@temple.edu Charles Library(215) 204-4724 Subjects: Earth & Environmental Science, Engineering, Mathematics Librarian Karen Kohn Email Me Contact: Paley Library, Room 101215-204-4428 Last Updated: Dec 15, 2021 9:13 AM URL: https://guides.temple.edu/APIs Print Page Login to LibApps Report a problem. Tags: API, Application Programming Interface, research methodology, scraping

karnesky commented on Sep 1, 2013 A few things to note here: arXiv does have preprints, but a lot of these are linked to journal articles & some people use it as a reprint server. If an arXiv record has a DOI, I would suggest (strongly) that it should be typed as a journal article. We may even just use the ADS link, which seems to have a great BibTeX-formatted record for most eprints (though I'm torn on doing that). NASA ADS and most others classify arXiv eprints as journal articles anyway. Zotero will import any of those as journal articles, so there might be a case to import all arXiv eprints as if they were journal articles

According to the biblatex manual ftp://bay.uchicago.edu/CTAN/macros/latex/exptl/biblatex/doc/biblatex.pdf section 3.11.7, arxivprefix is an alias for eprinttype and primaryclass is an alias for eprintclass.

uses in general the fields archivePrefix, eprint and primaryClass

Adstex (Github, PyPI), written by Yao-Yuan Mao, allows you to bypass downloading BibTeX or other paper metadata to a master local database. Instead, you write your paper using TeX and cite commands as normal, then run adstex on the TeX document. The tool checks your paper for any cite commands, queries ADS, and downloads the necessary BibTeX entries to a .bib file for the paper.

For first author + year citation keys, by default adstex would only search the astronomy database on NASA ADS. However, you can use --include-physics to include the ADS physics database.