/l/ - The Lounge

Off-topic discussion

All users of /b/: read >>>/meta/3253
[Make a Post]
[X]





Nanonymous No.7546 [D][U][F][S][L][A][C]
File: b2197aa6919341113e5b1a8f1304db395db39424b3da120b7da159bf99abaa4e.png (dl) (42.96 KiB)

I always used fresh onions to look for websites on tor and now the http://vps7nsnlz3n4ckiie5evi5oz2znes7p57gmrvundbmgat22luzd4z2id.onion/ link is down, is there a a new link or some shit?

sage sage No.7549 [D][U][F] >>7555
File: a28453bbc9f5cd171315fc9b4a0455e9812e7ee249b8d62e5bcbcefdba1255ed.jpg (dl) (23.78 KiB)

A thread died for this you stupid faggot.

Nanonymous No.7551 [D] >>7945

nope, og owner is awol and the link you posted was someone else. You can download the source and run your own but it is a real complex mess. Maybe I will run one when I feel like setting up a VM for it.

Nanonymous No.7554 [D]

Does anyone else have a similar web crawler link?

Nanonymous No.7555 [D]

>>7549
No it didn't

Nanonymous No.7899 [D] >>7911

Where's the source?

Nanonymous No.7911 [D] >>7945

>>7899
If I had to reverse engineer it, I imagine it's some scraping of pastebin for onion addresses, some code to try connecting to addresses, and a database to store the results.

https://pastebin.com/api_scraping_faq

Nanonymous No.7920 [D]

>>>/g/1873

Nanonymous No.7922 [D]

Rly missing Harry71 too

Nanonymous No.7945 [D] >>7951

>>7911
I found the source on github: https://github.com/dirtyfilthy/freshonions-torscraper

>>7551
is right, the code is a mess. You don't need all the privoxy/squid stuff. Here, I wrote this:

package main

import (
"github.com/cretz/bine/tor"
"github.com/gocolly/colly"
"github.com/gocolly/colly/proxy"
"log"
"strconv"
)

func main() {
log.Printf("Starting.")
c := colly.NewCollector(colly.AllowURLRevisit())
rp, err := proxy.RoundRobinProxySwitcher(startTorProxies(6)...)
if err != nil {
log.Fatal(err)
}
c.SetProxyFunc(rp)
c.OnRequest(func(r *colly.Request) {
log.Println("Visiting", r.URL)
})
c.OnHTML("a[href]", func(e *colly.HTMLElement) {
e.Request.Visit(e.Attr("href"))
})

c.Visit("http://vps7nsnlz3n4ckiie5evi5oz2znes7p57gmrvundbmgat22luzd4z2id.onion/")
}

func startTorProxies(numProxies int) []string {
var count = 0
var port = 9860
var proxies = make([]string, numProxies)
for count < numProxies {
var portStr = strconv.Itoa(port)
_, err := tor.Start(nil, &tor.StartConf{NoAutoSocksPort: true, ExtraArgs: []string{"--SocksPort", portStr}})
if err == nil {
count++
proxies = append(proxies, "socks5://12.0.0.1:"+portStr)
log.Printf("Created proxy %s", proxies[len(proxies)-1])
}
port++

}
return proxies
}


Nanonymous No.7951 [D]

>>7945
>import <remote_url>
Institutionalized curlbashing. Refiend.

Nanonymous No.8497 [D]

Teh next neo plz docker this