• Member : 蔡昀達, 廖其忻
• Meeting :

ISCX-URL-2016(https://www.unb.ca/cic/datasets/url-2016.html)

kaggle

1. https://www.kaggle.com/antonyj453/urldataset
2. https://www.kaggle.com/aktank/url-detection
3. https://www.kaggle.com/deepak730/finding-malicious-url-through-url-features

Phising URLS

1. Phishtank https://www.phishtank.com/developer_info.php
2. Open Phis https://openphish.com/

SPAM URLS

1. JWSPAMSPY http://www.joewein.de/sw/blacklist.htm

Malware URLS (These three does not update for a long time)

1. DNS-BH - http://www.malwaredomains.com/wordpress/?page_id=66
2. https://www.malwarepatrol.net/my-account/
3. http://www.malwaredomainlist.com/

Benign URLS

1. Majestic - https://majestic.com/reports/majestic-million

Other Source

1. https://zeltser.com/malicious-ip-blocklists/

###### Black list

1. EtherAddressLooup - https://etherscamdb.info/api
2. Bambenek consulting - https://osint.bambenekconsulting.com/feeds/
3. firehol - http://iplists.firehol.org/
4. Spamhaus and DShield - http://www.squidblacklist.org/downloads/drop.malicious.rsc
5. squidguard - http://www.squidguard.org/blacklists.html
6. blackweb - https://github.com/maravento/blackweb

White List - https://www.alexa.com/topsites

- Chrome外掛軟體 Googel WOT plugin

#####

- http://whois.domaintools.com

- https://www.urlvoid.com

- https://www.ipvoid.com/

- https://www.apivoid.com/api/domain-reputation/

#####

Black List (目前沒有可利用的資料)

- (主要是查IP)https://www.abuseipdb.com/

- (主要是Domain Name，僅參考)https://www.riskiq.com/platform/architecture/internet-data-sets/passive-dns/

- (黑名單太少，參考用)https://otx.alienvault.com/

1. check basline CNN model has high accuracy
2. build tfidf model
3. build explain feature
   1. triggered pattern
   2. malicious url family matching
4. phishing url survey

1. Collect training data
2. Collect whois information
3. manual feature
4. model desgin

https://hackmd.io/RKXNLcvUQY2a-cQAESigqw?view