Torrent Monitor

From LordMattWiki

Jump to: navigation, search

A protocol and PoC plan for a BitTorrent search system that holds no Torrent files and is (almost) imune to take-down requests.

The ultimate search engine for peer-to-peer as it operates itself peer-to-peer and itself only monitors torrent information.

Torrent Moniter

  • XML_RPC
    • GetTMServers($Me) (Requests TM Server Listings)
    • SendTMServers($Me, $Servers) (Gives TM Server Listings)
    • GetByServer($BaseUrl, $Me) (Requests tracked torrents from a given server)
    • GetByTopical($Search, $Me) (Requests Torrent data by topic/search)

Contents

[edit] DataBase

[edit] Servers

  • PeerServers
    • BaseURL (where we talk to etc)
    • PublicIndexPage (where we link to)
    • Name (what we call it)
    • LastReportedVersion (of TM)
    • XML_RPC URL
    • LastPingAverage
    • LastTookUpdate
    • LastGaveUpdate
    • Flags [DONOTUSE]
    • Rating
  • PS_Log
    • ServerUsed (BaseURL)
    • Action (Give/Take)
    • Servers (added/given)
    • date-time stamp
  • TorrentServers (To query for torrents)
    • BaseURL
    • Name
    • LastQuery (timeStamp)
    • FrquencyCap (limit on queries in any given hour)

[edit] Torrent

  • Torrent
    • HASH
    • Text (Files Reported)
    • LastTestedPeerCount
    • LastTestedSeedCount
    • LastTestedShareRatio
    • AutoIndexTags
    • LastQueried
    • FirstDiscovered (date of first successfull query form this server)
    • Flags (space dilimeted text)
    • PeerFetchedFrom
  • T_Server
    • HASH
    • TrackerURL
    • .Torrent file URL
    • LastTested
    • Health
  • T_takedown
    • HASH
    • TrackerURL
    • .Torrent file URL
    • RequesterIP
    • RequesterServerVarsDump
    • FilesInConflict
    • ReasonForConflict
    • RequesterWhois (The who are you info)
    • TimeStamp

(One Torrent to one or more T_Server)

[edit] System

  • MagicWords
    • Word (to look for to add as tag)
    • Count (needed)
    • Wieght (lighter words float to top. Top n are used)
  • Settings
    • SKey
    • Setting
    • Value


[edit] Dev Ideas

The system would act like a giant peer-to-peer search engine of peer-to-peer files. It would significantly have no torrent files itself taking the data it needs and then dropping the torrent file.

Links would be to other peoples torrent files.

[edit] Take Down Requests

These would be handled via a special form linked to from every page and information page.

It would require that the person fill out the details of who there are, what the torrent contains and in what way it breaches thier copyright. After they have filed their complaint the system will check settigns to see if the URL hosting the tracker is flagged as owned by TM site. If not the complainer will be forwarded to a page thanking them for highlighting this issue and telling them where the tracker file is located and a general we have no control over that file disclaimer. If the flag is set then the complainer will get an assurence that the information will be reviewed within the next 48 hours.

A wise opporator will take down as requested if the content is ileagle.

Complainers who winge for no reason could be banned via the recorded IP.

[edit] Peer-to-pper Search

The search system is based on tagging however the system will automatically make the tags useing the MagicWords table.

The admin(s) can then further edit the tags to fine tune them.

When a user searches the result set returns based on tags (and optionally full test search) but with more wieght given to tags). This should serve to make torrent data easier to find.

In addition the system will select one or two known peers and search them via the GetByTopical($Search, $Me) XML API. These reults will be addded to the data base as is and flagged as unrefined. These results will be merged with the systems own results and sorted before the results are then given to the searcher.

[edit] Automation - crons

Each cron or psudo-cron event will cause the system to re-evaluate Flagged (as unrefined) entries and add tags not present based on the MagicWords table. It will then flag it for Admin attention.

[edit] Flags

The flag system is a collection of words or CamelCase phrases that are tagged onto torrent data for the use of the system

  • unrefined - torrent data fresh in
  • admin - ready for the admin to look at (such flagged torrents appear with newest first on the admin page).
  • ObjectedLocal - This torrent has been flagged as objected to
  • ...

[edit] PeerFlags

Peer flags are a way to shut out noisy and inpolite peers.

  • DoNotUSe - Marked as not to be used
  • DoNotShare - don't share with this peer
  • DoNotAllowSearch - don't let this peer search
  • DoNotSearch - Don't search on this Peer
  • DoNotRequestShare - don't get peer up dates from this peer
Retrieved from "http://wiki.lordmattandyou.com/index.php/Torrent_Monitor"
Personal tools