Zenodo and IA Scholar

The Internet Archive’s Scholar service is being filled with junk on junk domains, via Zenodo…

It’s been like this for months now, and there’s no way to say “No Zenodo” in results. Apparently at Zenodo…

We are currently in the process of moving Zenodo on top of our next-generation platform … together with 25 other partners. (Dec 2022)

… so it would be a pity if the larger new project found itself inadvertently ingesting all this DOI-assigned piffle from the old service. The PDFs are randomly-assembled jumbled-up fragments of serious-sounding texts and TOCs.

---

Update: Two weeks later, still not fixed…

GitHub code search (beta)

GitHub code search, currently in beta with a sign-up required.

The technology behind its speed (regular keyword search doesn’t scale well for code search) is explained in a new blog post.

Google Searching Tags Box

A new UserScript Google Searching Tags Box. For repeat searches, add tags to the Google Search main page. The code looks clean to me, and it should work, though I couldn’t get it working at all. Even with element-blockers turned off and the page force-reloaded. But this problem might just be due to a cache that’s reluctant to refresh.

Another way to add a frequently used search modifier — such as site:www.yoursearchybigsite.com — is to use a right-click snippet added via a Web browser add-on. I use Paste Email, which can be configured to paste any snippet of text from a right-click of the mouse.

Missing in open

Google Scholar has a useful new feature. If an article was funded from the public purse, and yet not freely published online with the agreed time, then Scholar will flag that the expected public open access version is missing.

However the flags appear on the Scholar Profile section, not as a red flag alongside each search result.

Taking a purely random example, this is what appears on the sidebar of the author’s page…

On clicking through from this widget, one gets a list with the missing papers sorted to the top…

You can see that the OA mandates are usefully itemised per-paper.

Provided you don’t want Providence…

The New York Public Library has a keyword-substitution problem. Search for Providence, with or without a capital letter or “quote marks”. Sort by “date digitized”, and get a wall of useless results for…

provide, provided, provides etc.

One-click to remove a verbose site from Google

One-click to remove a verbose site from Google Search results, a new UserScript. Preset for Wikipedia, but the URL can be easily changed to be any verbose website. It should ideally be a website that you usually regularly want to remove from search results, but sometimes want to keep. The script is thus more flexible than a regular list-based site blocker.

It works by re-running the current search, but only an instant after some regex has cunningly inserted the command    into the URL.

---

Also, yes, I’m aware that my ‘add JURN as a link to Google Search’ UserScript has stopped working. Google has re-labelled the divs on the text links just below the search box. A similar script that allows the current search to be passed to Scholar has also stopped working, as have several similar menu scripts. I’m waiting for one of these scripts to update, and thus to show me how it needs to be fixed.

“How reliable and useful is Cabell’s Blacklist?”

New at Liber Quarterly, “How reliable and useful is Cabell’s Blacklist? A data-driven analysis”.

Towards a meta-pedia browser add-on

An interesting idea: a meta-pedia browser add-on, to consult all public encyclopedias at the same time. Presenting the results as an elegant full-screen dashboard with a strip of side-links to Google Books, Archive.org, Scholar, JURN etc. Ideally with configurable sources…

* Wikipedia
* Current Britannica
* 1911 Britannica
* Specialist public encyclopedias is they exist for the topic, e.g. Philosophy, Catholic, Science-fiction etc.

I’m assuming this would need to be a browser add-on, as a cloud service that did this would face lawsuits and frame-busting scripts. The closest I can find is 2019’s free ResearchKit which shows Wikipedia and the current Britannica side-by-side, above bot-driven auto-summaries of their text. It’s not exactly elegant to look at it, but it works.

Obviously some fuzzy-lookup might be needed to align search topics, though the individual encyclopedias strive to do that on their pages via navigation strips and links.

But rather than jumping straight to a presumed page, perhaps each encyclopedia panel might first show sub-panels with a half-dozen ‘possible’ hits, colour-shaded by order of likely relevance to the search. If such a browser addon was in widespread use, the data gathered from such mass human-driven topic-selection/alignment might be rather useful, over time being judiciously used to augment existing ‘knowledge navigation trees’ that are able to cope at a meta-level with shifting topic titles (e.g. Aetheopia > Abyssinia > Horn of Africa > Eastern Africa > Ethiopia).

Another way to do it might be for the addon to ‘read’ such existing navigation on the encyclopedia pages, make its own deft distillation of such, and then use that to ‘prime’ with keywords the sidebar links to Google Books, Archive.org, Scholar, JURN etc.

On auto-downloading open access books

Martin Paul Eve has a new post on Zotero and auto-downloading open access books…

all I really wanted was to be able to embed an ISBN and a citation_pdf_url and have Zotero do the lookup and save the file. However, out of the box there is no easy way to do this.

His test book is quite interesting, his own new Close Reading with Computers: Textual Scholarship, Computational Formalism, and David Mitchell’s Cloud Atlas (April 2020), which applies textual computing to the science-fiction-philosophy novel Cloud Atlas.

I don’t know about or use the current version of Zotero, so I’m unsure what advantages it confers. I assume Eve intended to find a way to automatically harvest all CC-SA books in PDF, and build a local collection for automated analysis.

But I see his book is already on the OA book aggregator catalogue OAPEN. Theoretically then, since OAPEN is comprehensive and timely, one could have a harvester look at all the pages hanging off library.oapen.org/handle/ and save out only those pages with the required permissive CC “Rights” label on them. These pages each have a uniform PDF link URL in their HTML, in the form of library.oapen.org/bitstream/ and these could be easily extracted to a list. One would end up with a set of PDF links for a linkbot, ready to download to a local folder for computational analysis. I presume that’s what Eve intended to have Zotero do.

One would need to reference the OAPEN record page first, in the way I’ve suggested, since the PDF itself can have different or non-uniform or contradictory licence information. For instance in its interior Eve’s book is labelled as both “©” … “No part of this book may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording, or in any information storage or retrieval system without the prior written permission of Stanford University Press.” and also “Creative Commons Attribution-ShareAlike 4.0”.

How many items on OAPEN have a creativecommons.org/licenses/by-sa/ “Rights” label at present, as Martin’s book does? A Google site: search suggests around 650 titles. Half an hour of my filtering the OAPEN CSV suggests it’s actually just over 3,000 under some form of permissive CC that permits commercial use. That’s still a manageable harvest at present. But as the supply of OA books and monographs grows rapidly, the likely result of various OA mandates in the near-future, it might be a useful time-saver for text-miners and digital humanists if OAPEN were to maintain a single torrent of all the PDFs. Inside which a half dozen folders would neatly organise the books by CC licence type. Such a one-click solution might save a lot of faffing around with digging into and filtering their XML and CSV feeds, wrangling with harvester scripts and timeouts, or trying to wrestle with third-party services such as Zotero. A torrent could also save OAPEN’s bandwidth.

Global leaders ask publishers to make “all COVID-19 research … immediately available to the public”

Issued yesterday from President Trump’s office, but so far unreported in the virus news I’ve seen…

“The U.S. Coronavirus Task Force leader, Dr. Kelvin Droegemeier, and government science leaders including science ministers and chief science advisors from Australia, Brazil, Canada, Germany, India, Italy, Japan, the Republic of Korea, New Zealand, Singapore, and the United Kingdom are asking publishers to make all COVID-19-related research and data immediately available to the public. … Science leaders requested that existing and new articles be made available in machine-readable format to allow full text and data mining with rights accorded for research re-use and secondary analysis.”