Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Atom feed or h-entry item subscription option for tag search results #27

Closed
thadguidry opened this issue Jan 28, 2022 · 6 comments
Closed

Comments

@thadguidry
Copy link

thadguidry commented Jan 28, 2022

Proposal

I'd like to subscribe to an Atom feed for datasets &c6=1 with tag wikidata .
Given: https://academictorrents.com/browse.php?search=wikidata&c6=1
rather than remembering to do a search to check on new files of interesting tags.

Quick and Easy Alternatives:

Having the search results table formatted with h-entry item per file. http://microformats.org/wiki/h-feed where the h-feed element would be absent since it could be implied.

Additional Context

https://developer.mozilla.org/en-US/docs/Web/HTML/microformats

@ieee8023
Copy link
Member

Hmm, we have an RSS feed for all new public data https://academictorrents.com/rss.xml and also a feed for every public torrent with the title of the entry that you could filter: https://academictorrents.com/database.xml

One issue with creating dynamic search feeds is there is a community of people that latch on to these for meta torrent search platforms and we get so much traffic that it is like a DDOS to the site.

Another solution is if someone curated all the wikidata entries into a collection which has RSS and CSV feeds for automatic mirroring? https://academictorrents.com/collections.php

We also prevent the browse.php endpoint from being scraped directly so I don't think the h-entry solution would work. Maybe there is another solution I am not thinking of?

@thadguidry
Copy link
Author

thadguidry commented Jan 28, 2022

@ieee8023 Oh great then! That RSS feed works for me just fine.

  • Maybe add a feed link at the bottom after About - Terms - Feed ?
@ieee8023
Copy link
Member

Oh, great idea! Will do! I'll leave this issue open until it is live.

@thadguidry
Copy link
Author

@ieee8023 Hahaha, OK, it would be useful, and would indeed bring more searchability and visibility to AT through Search engines and even folks using Common Crawl.

@ieee8023
Copy link
Member

@thadguidry I just added those to the footer and reworked the feeds so they have extra info and cleanly present the description. Let me know if have any ideas for improvement. Thanks for bringing up this issue!

@thadguidry
Copy link
Author

@ieee8023 Looks and works perfect! (tested with Feedly and Mozilla's Thunderbird)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants