 » Site Navigation | | | | » Advertisement | | | | » Recent Threads | | | | |  ... Yesterday 03:53 PM Today 07:08 AM 5 Replies, 43 Views | | | | | |  | |  | +REP and +THANKS if you find this for me. |  | 
04-18-2009, 09:26 PM
|
#1 (permalink)
| Slash Gash Terror Crew  
Join Date: May 2008 Posts: 2,372
GPoints: 3,811 Rep Power: 18 | +REP and +THANKS if you find this for me.
A program that will remove duplicate lines of text from .txt files. I found one but it doesn't seem to be working, I need a program that can handle over 500k worth of lines.
(P.S. thanks for finding those word lists Gato)
__________________ See. you're a freak,
Like me!
Bend over,
Shake those titties.
Pull over,
Hello Kitty.
Back it up like a U-Haul truck,
Sock it to me, rub my junk.
It's so hard to be a diamond in a rhinestone world
You got my heart and it's beating for a girl <3
| |
|  | |
04-18-2009, 10:04 PM
|
#2 (permalink)
| Donor
Join Date: Nov 2006 Location: Ontario Age: 19 Posts: 2,356
GPoints: 8,257 Rep Power: 17 | Fuck I made one of these a little while ago I'll try to find it for you and edit this post.
edit: Found it. Fucking oldschool. Not too sure if its what your looking for or if it will even work for that many lines.
Last edited by Aethean; 04-18-2009 at 10:07 PM..
| |
| | | The Following User Says Thank You to Aethean For This Useful Post: | | |
04-18-2009, 10:31 PM
|
#3 (permalink)
| Slash Gash Terror Crew
Join Date: May 2008 Posts: 2,372
GPoints: 3,811 Rep Power: 18 | Well it worked in the fact that it loaded both lists, but it only put out the A's from the list. So I went from about 3 mb worth of words to 32k. Thanks anyways lol. Hopefully someone else will be able to find me one. Hell you could probably program one in the time it takes people to fulfill this request.
__________________ See. you're a freak,
Like me!
Bend over,
Shake those titties.
Pull over,
Hello Kitty.
Back it up like a U-Haul truck,
Sock it to me, rub my junk.
It's so hard to be a diamond in a rhinestone world
You got my heart and it's beating for a girl <3
| |
| | |
04-18-2009, 10:37 PM
|
#4 (permalink)
| Donor
Join Date: Nov 2006 Location: Ontario Age: 19 Posts: 2,356
GPoints: 8,257 Rep Power: 17 | Only put out the A's? Can you upload the list for me and you want all the duplicates removed? | |
| | |
04-18-2009, 10:58 PM
|
#5 (permalink)
| Slash Gash Terror Crew
Join Date: May 2008 Posts: 2,372
GPoints: 3,811 Rep Power: 18 | Quote:
Originally Posted by Aethean  Only put out the A's? Can you upload the list for me and you want all the duplicates removed? | Download - WordLists.zip - Sharebee.com, the one and only online file hosting distribution service.
I need wordlist.txt and wordlist2.txt combined, then have the dupes removed. Deduped.txt (?) is obviously what came out of the deduper.
__________________ See. you're a freak,
Like me!
Bend over,
Shake those titties.
Pull over,
Hello Kitty.
Back it up like a U-Haul truck,
Sock it to me, rub my junk.
It's so hard to be a diamond in a rhinestone world
You got my heart and it's beating for a girl <3
| |
| | |
04-18-2009, 11:20 PM
|
#6 (permalink)
| Banned
Join Date: Oct 2008 Age: 19 Posts: 2,473
GPoints: 8,935 Rep Power: 0 | Damn, the only one I could find wouldn't even load the first list:/ | |
| | |
04-18-2009, 11:20 PM
|
#7 (permalink)
| Donor
Join Date: Nov 2006 Location: Ontario Age: 19 Posts: 2,356
GPoints: 8,257 Rep Power: 17 | Alright loaded the lists and the updated one is running but it seems like its going to take a long ass time, so when its done or if its done properly ill upload the new list. | |
| | | The Following User Says Thank You to Aethean For This Useful Post: | | |
04-18-2009, 11:22 PM
|
#8 (permalink)
| Slash Gash Terror Crew
Join Date: May 2008 Posts: 2,372
GPoints: 3,811 Rep Power: 18 | Quote:
Originally Posted by Aethean Alright loaded the lists and the updated one is running but it seems like its going to take a long ass time, so when its done or if its done properly ill upload the new list. |
If the program works properly you should post it somewhere on the site, that way people can run password lists and cut them down if they have dupes, and does it check for exact dupes? Like it won't choose Alf over alf? It'll accept both of those as non duplicates right?
__________________ See. you're a freak,
Like me!
Bend over,
Shake those titties.
Pull over,
Hello Kitty.
Back it up like a U-Haul truck,
Sock it to me, rub my junk.
It's so hard to be a diamond in a rhinestone world
You got my heart and it's beating for a girl <3
| |
| | |
04-18-2009, 11:26 PM
|
#9 (permalink)
| Donor
Join Date: Nov 2006 Location: Ontario Age: 19 Posts: 2,356
GPoints: 8,257 Rep Power: 17 | Didn't work quite right yet. Uh Im going to go to bed now and work on it again later today. As of now it turns everything into lowercase then gets rid of the dupes, if thats what you wanted?
edit: wow I like forget everything about vb6. You'd probably be better off asking someone else as Im trying to relearn everything =/
Last edited by Aethean; 04-19-2009 at 04:14 PM..
| |
| | |
04-19-2009, 12:16 AM
|
#10 (permalink)
| Slash Gash Terror Crew
Join Date: May 2008 Posts: 2,372
GPoints: 3,811 Rep Power: 18 | Quote:
Originally Posted by Aethean Didn't work quite right yet. Uh Im going to go to bed now and work on it again later today. As of now it turns everything into lowercase then gets rid of the dupes, if thats what you wanted? | lowercase is fine. I think everything is already lowercase, but I could be wrong.
__________________ See. you're a freak,
Like me!
Bend over,
Shake those titties.
Pull over,
Hello Kitty.
Back it up like a U-Haul truck,
Sock it to me, rub my junk.
It's so hard to be a diamond in a rhinestone world
You got my heart and it's beating for a girl <3
| |
| | | |
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | | | | Thread Tools | | | | Display Modes |  Linear Mode |
Posting Rules
| You may not post new threads You may not post replies You may not post attachments You may not edit your posts
HTML code is Off
| | |
|
