• Directory
  • FAQ: about JURN
  • Group tests
  • Guide to academic search
  • JURN’s donationware
  • openEco: nature titles indexed

News from JURN

~ search tool for open access content

News from JURN

Category Archives: How to improve academic search

Zenodo and IA Scholar

10 Friday Feb 2023

Posted by David Haden in How to improve academic search

≈ Leave a comment

The Internet Archive’s Scholar service is being filled with junk on junk domains, via Zenodo…

It’s been like this for months now, and there’s no way to say “No Zenodo” in results. Apparently at Zenodo…

We are currently in the process of moving Zenodo on top of our next-generation platform … together with 25 other partners. (Dec 2022)

… so it would be a pity if the larger new project found itself inadvertently ingesting all this DOI-assigned piffle from the old service. The PDFs are randomly-assembled jumbled-up fragments of serious-sounding texts and TOCs.


Update: Two weeks later, still not fixed…

GitHub code search (beta)

08 Wednesday Feb 2023

Posted by David Haden in How to improve academic search, Spotted in the news

≈ Leave a comment

GitHub code search, currently in beta with a sign-up required.

The technology behind its speed (regular keyword search doesn’t scale well for code search) is explained in a new blog post.

Google Searching Tags Box

09 Monday May 2022

Posted by David Haden in How to improve academic search, Spotted in the news

≈ Leave a comment

A new UserScript Google Searching Tags Box. For repeat searches, add tags to the Google Search main page. The code looks clean to me, and it should work, though I couldn’t get it working at all. Even with element-blockers turned off and the page force-reloaded. But this problem might just be due to a cache that’s reluctant to refresh.

Another way to add a frequently used search modifier — such as site:www.yoursearchybigsite.com — is to use a right-click snippet added via a Web browser add-on. I use Paste Email, which can be configured to paste any snippet of text from a right-click of the mouse.

Missing in open

27 Sunday Jun 2021

Posted by David Haden in How to improve academic search, Spotted in the news

≈ Leave a comment

Google Scholar has a useful new feature. If an article was funded from the public purse, and yet not freely published online with the agreed time, then Scholar will flag that the expected public open access version is missing.

However the flags appear on the Scholar Profile section, not as a red flag alongside each search result.

Taking a purely random example, this is what appears on the sidebar of the author’s page…

On clicking through from this widget, one gets a list with the missing papers sorted to the top…

You can see that the OA mandates are usefully itemised per-paper.

Provided you don’t want Providence…

14 Sunday Mar 2021

Posted by David Haden in How to improve academic search

≈ Leave a comment

The New York Public Library has a keyword-substitution problem. Search for Providence, with or without a capital letter or “quote marks”. Sort by “date digitized”, and get a wall of useless results for…

provide, provided, provides etc.

One-click to remove a verbose site from Google

11 Thursday Mar 2021

Posted by David Haden in How to improve academic search, JURN tips and tricks, Regex

≈ Leave a comment

One-click to remove a verbose site from Google Search results, a new UserScript. Preset for Wikipedia, but the URL can be easily changed to be any verbose website. It should ideally be a website that you usually regularly want to remove from search results, but sometimes want to keep. The script is thus more flexible than a regular list-based site blocker.

It works by re-running the current search, but only an instant after some regex has cunningly inserted the command    into the URL.


Also, yes, I’m aware that my ‘add JURN as a link to Google Search’ UserScript has stopped working. Google has re-labelled the divs on the text links just below the search box. A similar script that allows the current search to be passed to Scholar has also stopped working, as have several similar menu scripts. I’m waiting for one of these scripts to update, and thus to show me how it needs to be fixed.

“How reliable and useful is Cabell’s Blacklist?”

29 Tuesday Sep 2020

Posted by David Haden in How to improve academic search, Spotted in the news

≈ Leave a comment

New at Liber Quarterly, “How reliable and useful is Cabell’s Blacklist? A data-driven analysis”.

Towards a meta-pedia browser add-on

11 Thursday Jun 2020

Posted by David Haden in Academic search, How to improve academic search

≈ Leave a comment

An interesting idea: a meta-pedia browser add-on, to consult all public encyclopedias at the same time. Presenting the results as an elegant full-screen dashboard with a strip of side-links to Google Books, Archive.org, Scholar, JURN etc. Ideally with configurable sources…

* Wikipedia
* Current Britannica
* 1911 Britannica
* Specialist public encyclopedias is they exist for the topic, e.g. Philosophy, Catholic, Science-fiction etc.

I’m assuming this would need to be a browser add-on, as a cloud service that did this would face lawsuits and frame-busting scripts. The closest I can find is 2019’s free ResearchKit which shows Wikipedia and the current Britannica side-by-side, above bot-driven auto-summaries of their text. It’s not exactly elegant to look at it, but it works.

Obviously some fuzzy-lookup might be needed to align search topics, though the individual encyclopedias strive to do that on their pages via navigation strips and links.

But rather than jumping straight to a presumed page, perhaps each encyclopedia panel might first show sub-panels with a half-dozen ‘possible’ hits, colour-shaded by order of likely relevance to the search. If such a browser addon was in widespread use, the data gathered from such mass human-driven topic-selection/alignment might be rather useful, over time being judiciously used to augment existing ‘knowledge navigation trees’ that are able to cope at a meta-level with shifting topic titles (e.g. Aetheopia > Abyssinia > Horn of Africa > Eastern Africa > Ethiopia).

Another way to do it might be for the addon to ‘read’ such existing navigation on the encyclopedia pages, make its own deft distillation of such, and then use that to ‘prime’ with keywords the sidebar links to Google Books, Archive.org, Scholar, JURN etc.

On auto-downloading open access books

21 Tuesday Apr 2020

Posted by David Haden in How to improve academic search, My general observations, Spotted in the news

≈ Leave a comment

Martin Paul Eve has a new post on Zotero and auto-downloading open access books…

all I really wanted was to be able to embed an ISBN and a citation_pdf_url and have Zotero do the lookup and save the file. However, out of the box there is no easy way to do this.

His test book is quite interesting, his own new Close Reading with Computers: Textual Scholarship, Computational Formalism, and David Mitchell’s Cloud Atlas (April 2020), which applies textual computing to the science-fiction-philosophy novel Cloud Atlas.

I don’t know about or use the current version of Zotero, so I’m unsure what advantages it confers. I assume Eve intended to find a way to automatically harvest all CC-SA books in PDF, and build a local collection for automated analysis.

But I see his book is already on the OA book aggregator catalogue OAPEN. Theoretically then, since OAPEN is comprehensive and timely, one could have a harvester look at all the pages hanging off library.oapen.org/handle/ and save out only those pages with the required permissive CC “Rights” label on them. These pages each have a uniform PDF link URL in their HTML, in the form of library.oapen.org/bitstream/ and these could be easily extracted to a list. One would end up with a set of PDF links for a linkbot, ready to download to a local folder for computational analysis. I presume that’s what Eve intended to have Zotero do.

One would need to reference the OAPEN record page first, in the way I’ve suggested, since the PDF itself can have different or non-uniform or contradictory licence information. For instance in its interior Eve’s book is labelled as both “©” … “No part of this book may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording, or in any information storage or retrieval system without the prior written permission of Stanford University Press.” and also “Creative Commons Attribution-ShareAlike 4.0”.

How many items on OAPEN have a creativecommons.org/licenses/by-sa/ “Rights” label at present, as Martin’s book does? A Google site: search suggests around 650 titles. Half an hour of my filtering the OAPEN CSV suggests it’s actually just over 3,000 under some form of permissive CC that permits commercial use. That’s still a manageable harvest at present. But as the supply of OA books and monographs grows rapidly, the likely result of various OA mandates in the near-future, it might be a useful time-saver for text-miners and digital humanists if OAPEN were to maintain a single torrent of all the PDFs. Inside which a half dozen folders would neatly organise the books by CC licence type. Such a one-click solution might save a lot of faffing around with digging into and filtering their XML and CSV feeds, wrangling with harvester scripts and timeouts, or trying to wrestle with third-party services such as Zotero. A torrent could also save OAPEN’s bandwidth.

Global leaders ask publishers to make “all COVID-19 research … immediately available to the public”

14 Saturday Mar 2020

Posted by David Haden in How to improve academic search, Spotted in the news

≈ Leave a comment

Issued yesterday from President Trump’s office, but so far unreported in the virus news I’ve seen…

“The U.S. Coronavirus Task Force leader, Dr. Kelvin Droegemeier, and government science leaders including science ministers and chief science advisors from Australia, Brazil, Canada, Germany, India, Italy, Japan, the Republic of Korea, New Zealand, Singapore, and the United Kingdom are asking publishers to make all COVID-19-related research and data immediately available to the public. … Science leaders requested that existing and new articles be made available in machine-readable format to allow full text and data mining with rights accorded for research re-use and secondary analysis.”

← Older posts
Subscribe: RSS News Feed.
I'm on Patreon!

JURN:

  • JURN : directory of ejournals
  • JURN : main search-engine
  • JURN : openEco directory
  • JURN : repository search

Related sites:

  • 4 Humanities
  • Academic Freedom Alliance
  • Accuracy in Academia
  • Alliance Defending Freedom
  • ALPSP
  • alt.academy
  • AMIR
  • Anterotesis
  • Arcadia project
  • Art Historicum (German)
  • AWOL
  • Beall's List (updated at 2018)
  • Beall’s List (old)
  • Beyond Search
  • Bibliographic wilderness
  • Booktwo
  • Campus Reform
  • Charleston Advisor
  • Coalition for Networked Information
  • Communia (public domain watchdog)
  • Cost of Knowledge
  • Council of Editors of Learned Journals
  • Dan Cohen
  • Digital Koans
  • Digital Shift
  • Dissernet (Russian anti-plagiarism)
  • DOAJ
  • Don't Block TOR
  • eFoundations
  • EIFL
  • Electronic Frontier Foundation
  • ELO
  • Embargo Watch
  • ePublishing Trust for Development
  • Facebook: Arab Open Access
  • Facebook: Italian Open Access
  • Facebook: Open Access India
  • Film Studies for Free
  • FIRE
  • Flaky Academic Conferences
  • Found History
  • Foundation for Individual Rights in Education
  • Free Speech Union (UK)
  • Google Algorithm
  • Heterodox Academy
  • Iconclass
  • IFLA Serials blog
  • ImpactStory
  • infoDocket
  • InTech Blog
  • Jinfo (formerly Free Pint)
  • Kindle blog
  • L'edition Electronique (French)
  • La Criee : periodiques (French)
  • Leader Statement Database on Free Speech
  • National Association of Scholars
  • National Coalition of Independent Scholars
  • Neil Beagrie
  • OA Lookup : Policies
  • OA Working Group
  • OASPA
  • Online Searcher
  • Open Access Bibliography
  • Open Access Week
  • Open and Shut?
  • Open Electronic Publishing
  • Open Folklore
  • Open Knowledge Maps
  • Open Library of Humanities
  • Periodiques en ligne (French)
  • Peter Murray Rust
  • PKP / OJS
  • Project Gutenberg
  • Publishing Archaeology
  • RBA Blog
  • Reclaim the Net
  • Research Information
  • Research Remix
  • Right to Research
  • River Valley TV
  • ROARS (Italian)
  • Scholarly Electronic Publishing
  • Scholarship Matters
  • Searchblox
  • Searcher
  • Serials Cataloger
  • Serials Review
  • Society of Young Publishers
  • Speech First
  • TaxoDiary (taxonomies news)
  • Taxpayer Access
  • Tentaclii
  • The Scholarly Kitchen
  • Thoughts from Carl Grant
  • Web Scale Discovery
  • Zotero blog

Some of the libraries linking to JURN

  • Boston College Libraries
  • Brooklyn Public Library, NY
  • Duke University
  • Kobe University, Japan
  • Rhode Island College
  • San Jose State University
  • UConn Stamford
  • University of California
  • University of Cambridge (Casimir Lewy Library)
  • University of Cambridge (main)
  • University of Canberra
  • University of Toronto
  • Washington University
  • West Virginia University

Spare BitCoins? Please send donations to JURN via: 17e2KGuyzjzEEE7BsoYTwMo3MtUod6DrjP

Archives

  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • January 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021
  • May 2021
  • April 2021
  • March 2021
  • February 2021
  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • March 2020
  • February 2020
  • January 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • August 2018
  • July 2018
  • June 2018
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • November 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • March 2015
  • February 2015
  • January 2015
  • December 2014
  • November 2014
  • October 2014
  • September 2014
  • August 2014
  • July 2014
  • June 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • December 2013
  • November 2013
  • October 2013
  • September 2013
  • August 2013
  • July 2013
  • June 2013
  • May 2013
  • April 2013
  • March 2013
  • February 2013
  • January 2013
  • December 2012
  • November 2012
  • October 2012
  • September 2012
  • August 2012
  • June 2012
  • May 2012
  • April 2012
  • March 2012
  • February 2012
  • January 2012
  • December 2011
  • November 2011
  • October 2011
  • September 2011
  • August 2011
  • June 2011
  • April 2011
  • March 2011
  • February 2011
  • January 2011
  • December 2010
  • November 2010
  • October 2010
  • September 2010
  • August 2010
  • July 2010
  • June 2010
  • May 2010
  • April 2010
  • March 2010
  • February 2010
  • January 2010
  • December 2009
  • November 2009
  • October 2009
  • September 2009
  • August 2009
  • July 2009
  • June 2009
  • May 2009
  • April 2009
  • March 2009
  • February 2009

Create a free website or blog at WordPress.com.

  • Follow Following
    • News from JURN
    • Join 903 other followers
    • Already have a WordPress.com account? Log in now.
    • News from JURN
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...