Thank you for being a valued part of the CNET community. As of December 1, 2020, the forums are in read-only format. In early 2021, CNET Forums will no longer be available. We are grateful for the participation and advice you have provided to one another over the years.

Thanks,

CNET Support

General discussion

How to find dupe items in a file?

by Tinybeeber Jun 6, 2010 2:12AM PDT

I have a large firewall log listing intrusions from all over the world. Each entry is two lines, in part, containing the offending IP. There are duplicate entries scattered throughout the log. I need to collect each IP's listed entries, and it is almost impossible manually, as the list is compacted on Notepad. I would like to enter a specific IP and have a program list all entries for that IP. Any ideas of what program could accomplish this? So far, dupe finders I have tried only find files. I am XP Home, no network, no domain, on dial-up (NOT my choice).

Discussion is locked

2 Posts

- Collapse + Expand Details

- Collapse -

Should be able to identify duplicates if you put the info

by VAPCMD Jun 6, 2010 5:05AM PDT

into a spreadsheet.

VAPCMD

- Collapse -

I have to ask...

by MarkFlax Forum moderator Jun 6, 2010 7:32AM PDT

Sorry but where you said, "I need to collect each IP's listed entries", I assumed you were in an organisation that needed this information for some evaluation or other.

But I see you say you are on XP, no network or domain, so I have to ask why you would want to do this. Firewalls prevent intrusion all the time; I stopped my own firewall logging such intrusion attempts a long time ago as it was constantly logging hundreds a day from robot scanners and such.

But that's your business. If the log can be saved into .csv format, (Comma Separated Values), then it can be imported into a spreadsheet like Excel.

Mark

Back to PC Applications forum