proxy_pool 可以在 Github Action 中使用吗？

bnlyeluc 于 5个月前发布在 Git

关注(0)|答案(3)|浏览(110)

尝试没成功，结果如下

2023-08-18 19:13:30,844 launcher.py[line:45] INFO ProxyPool Version: 2.4.0
****************************************************************
*** ______  ********************* ______ *********** _  ********
*** | ___ \_ ******************** | ___ \ ********* | | ********
*** | |_/ / \__ __   __  _ __   _ | |_/ /___ * ___  | | ********
*** |  __/|  _// _ \ \ \/ /| | | ||  __// _ \ / _ \ | | ********
*** | |   | | | (_) | >  < \ |_| || |  | (_) | (_) || |___  ****
*** \_|   |_|  \___/ /_/\_\ \__  |\_|   \___/ \___/ \_____/ ****
****                       __ / /                          *****
************************* /___ / *******************************
*************************       ********************************
****************************************************************

2023-08-18 19:13:30,846 launcher.py[line:50] INFO ProxyPool configure HOST: 0.0.0.0
2023-08-18 19:13:30,846 launcher.py[line:51] INFO ProxyPool configure PORT: 5010
2023-08-18 19:13:30,847 launcher.py[line:52] INFO ProxyPool configure PROXY_FETCHER: ['freeProxy01', 'freeProxy02', 'freeProxy03', 'freeProxy04', 'freeProxy05', 'freeProxy06', 'freeProxy07', 'freeProxy08', 'freeProxy09', 'freeProxy10', 'freeProxy11']
2023-08-18 19:13:31,045 launcher.py[line:58] INFO ============ DATABASE CONFIGURE ================
2023-08-18 19:13:31,045 launcher.py[line:59] INFO DB_TYPE: REDIS
2023-08-18 19:13:31,045 launcher.py[line:60] INFO DB_HOST: 127.0.0.1
2023-08-18 19:13:31,045 launcher.py[line:61] INFO DB_PORT: 6379
2023-08-18 19:13:31,046 launcher.py[line:62] INFO DB_NAME: 0
2023-08-18 19:13:31,046 launcher.py[line:63] INFO DB_USER: 
2023-08-18 19:13:31,046 launcher.py[line:64] INFO =================================================
2023-08-18 19:13:31,304 fetch.py[line:65] INFO ProxyFetch : start
2023-08-18 19:13:31,304 fetch.py[line:68] INFO ProxyFetch - freeProxy01: start
2023-08-18 19:13:31,305 fetch.py[line:68] INFO ProxyFetch - freeProxy02: start
2023-08-18 19:13:31,305 fetch.py[line:68] INFO ProxyFetch - freeProxy03: start
2023-08-18 19:13:31,305 fetch.py[line:68] INFO ProxyFetch - freeProxy04: start
2023-08-18 19:13:31,306 fetch.py[line:68] INFO ProxyFetch - freeProxy05: start
2023-08-18 19:13:31,306 fetch.py[line:68] INFO ProxyFetch - freeProxy06: start
2023-08-18 19:13:31,306 fetch.py[line:68] INFO ProxyFetch - freeProxy07: start
2023-08-18 19:13:31,307 fetch.py[line:68] INFO ProxyFetch - freeProxy08: start
2023-08-18 19:13:31,307 fetch.py[line:68] INFO ProxyFetch - freeProxy09: start
2023-08-18 19:13:31,307 fetch.py[line:68] INFO ProxyFetch - freeProxy10: start
2023-08-18 19:13:31,307 fetch.py[line:68] INFO ProxyFetch - freeProxy11: start
2023-08-18 19:13:31,309 fetch.py[line:36] INFO ProxyFetch - freeProxy01: start
2023-08-18 19:13:31,309 fetch.py[line:36] INFO ProxyFetch - freeProxy02: start
2023-08-18 19:13:31,310 fetch.py[line:36] INFO ProxyFetch - freeProxy03: start
2023-08-18 19:13:31,315 fetch.py[line:36] INFO ProxyFetch - freeProxy04: start
2023-08-18 19:13:31,317 fetch.py[line:36] INFO ProxyFetch - freeProxy05: start
2023-08-18 19:13:31,319 fetch.py[line:36] INFO ProxyFetch - freeProxy06: start
2023-08-18 19:13:31,321 fetch.py[line:36] INFO ProxyFetch - freeProxy07: start
2023-08-18 19:13:31,323 fetch.py[line:36] INFO ProxyFetch - freeProxy08: start
2023-08-18 19:13:31,325 fetch.py[line:36] INFO ProxyFetch - freeProxy09: start
2023-08-18 19:13:31,325 fetch.py[line:36] INFO ProxyFetch - freeProxy10: start
2023-08-18 19:13:31,329 fetch.py[line:36] INFO ProxyFetch - freeProxy11: start
2023-08-18 19:13:31,893 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 211.161.103.139:9091    ok
2023-08-18 19:13:31,894 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 221.231.13.198:1080     ok
2023-08-18 19:13:31,894 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 120.197.219.82:9091     ok
2023-08-18 19:13:31,895 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.27.248.213:8085     ok
2023-08-18 19:13:31,895 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 120.48.109.157:8080     ok
2023-08-18 19:13:31,895 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 223.96.90.216:8085      ok
2023-08-18 19:13:31,896 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.237.47.54:9091      ok
2023-08-18 19:13:31,896 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 119.8.236.97:3128       ok
2023-08-18 19:13:31,896 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 61.53.66.116:9091       ok
2023-08-18 19:13:31,896 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 111.160.204.146:9091    ok
2023-08-18 19:13:31,897 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 124.90.211.64:8085      ok
2023-08-18 19:13:31,897 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 39.185.232.150:9091     ok
2023-08-18 19:13:31,897 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 112.54.41.177:9091      ok
2023-08-18 19:13:31,898 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 182.106.220.252:9091    ok
2023-08-18 19:13:31,899 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 42.228.61.245:9091      ok
2023-08-18 19:13:31,899 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 117.40.176.42:9091      ok
2023-08-18 19:13:31,899 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 113.195.3.249:8085      ok
2023-08-18 19:13:31,900 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 118.212.152.82:9091     ok
2023-08-18 19:13:31,900 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 112.54.47.55:9091       ok
2023-08-18 19:13:31,900 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 171.34.53.2:9091        ok
2023-08-18 19:13:31,901 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 120.234.137.132:9002    ok
2023-08-18 19:13:31,901 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 221.6.215.202:9091      ok
2023-08-18 19:13:31,902 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 121.31.35.98:9091       ok
2023-08-18 19:13:31,902 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 39.105.122.19:60080     ok
2023-08-18 19:13:31,903 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 223.84.240.36:9091      ok
2023-08-18 19:13:31,903 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 112.11.242.201:9091     ok
2023-08-18 19:13:31,903 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 111.21.183.58:9091      ok
2023-08-18 19:13:31,904 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 116.113.68.130:9091     ok
2023-08-18 19:13:31,904 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 124.90.211.233:8085     ok
2023-08-18 19:13:31,905 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 112.6.117.178:8085      ok
2023-08-18 19:13:31,905 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.233.169.226:9091    ok
2023-08-18 19:13:31,905 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 113.195.53.101:8085     ok
2023-08-18 19:13:31,906 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 124.90.210.57:8085      ok
2023-08-18 19:13:31,906 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 36.32.21.45:8085        ok
2023-08-18 19:13:31,906 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.220.6.198:9091      ok
2023-08-18 19:13:31,906 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 110.185.164.20:9091     ok
2023-08-18 19:13:31,907 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 61.132.228.99:8088      ok
2023-08-18 19:13:31,907 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 112.29.170.10:8088      ok
2023-08-18 19:13:31,907 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 120.196.188.21:9091     ok
2023-08-18 19:13:31,908 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.27.249.95:8085      ok
2023-08-18 19:13:31,910 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 118.31.2.38:8999        ok
2023-08-18 19:13:31,910 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 119.8.236.97:3128       ok
2023-08-18 19:13:31,911 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 123.183.160.83:9091     ok
2023-08-18 19:13:31,911 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 116.5.171.115:9002      ok
2023-08-18 19:13:31,911 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 39.105.122.19:60080     ok
2023-08-18 19:13:31,911 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 122.228.136.27:9091     ok
2023-08-18 19:13:31,912 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 123.57.233.117:60080    ok
2023-08-18 19:13:31,912 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 222.179.155.90:9091     ok
2023-08-18 19:13:31,912 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 36.99.165.148:9002      ok
2023-08-18 19:13:31,913 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 58.246.58.150:9002      ok
2023-08-18 19:13:31,913 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.237.177.31:9091     ok
2023-08-18 19:13:31,914 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 182.61.201.201:80       ok
2023-08-18 19:13:31,914 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.239.62.59:9091      ok
2023-08-18 19:13:31,914 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 124.225.20.144:9002     ok
2023-08-18 19:13:31,915 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 125.74.28.71:9002       ok
2023-08-18 19:13:32,171 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 47.111.173.88:8888      ok
2023-08-18 19:13:32,171 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 60.12.168.114:9002      ok
2023-08-18 19:13:32,172 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 8.45.176.194:80         ok
2023-08-18 19:13:32,172 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 61.183.234.226:9091     ok
2023-08-18 19:13:32,173 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 39.106.60.216:3128      ok
2023-08-18 19:13:32,173 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 111.178.11.20:8088      ok
2023-08-18 19:13:32,173 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 120.234.203.171:9002    ok
2023-08-18 19:13:32,173 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 222.138.76.6:9002       ok
2023-08-18 19:13:32,174 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 121.194.7.153:80        ok
2023-08-18 19:13:32,174 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 60.188.5.162:80         ok
2023-08-18 19:13:32,174 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 111.20.217.178:9091     ok
2023-08-18 19:13:32,174 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 111.20.217.178:9091     ok
2023-08-18 19:13:32,174 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 210.75.50.242:9002      ok
2023-08-18 19:13:32,175 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 113.195.207.249:9091    ok
2023-08-18 19:13:32,175 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 122.9.151.210:81        ok
2023-08-18 19:13:32,175 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 111.40.124.221:9091     ok
2023-08-18 19:13:32,175 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 183.247.199.51:30001    ok
2023-08-18 19:13:32,175 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 139.196.78.175:7890     ok
2023-08-18 19:13:32,528 webRequest.py[line:80] ERROR requests: http://www.66ip.cn/ error: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2023-08-18 19:13:32,528 webRequest.py[line:86] INFO retry 5 second after
2023-08-18 19:13:32,637 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.98:8089        ok
2023-08-18 19:13:32,637 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.144:8089       ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.194:8089       ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.220:8089       ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 114.231.46.233:8888     ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.148:8089       ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.106:8089       ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 223.247.46.96:8089      ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.161:8089       ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 114.231.8.167:8089      ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 121.4.138.93:3128       ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.124:8089       ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.250:8089       ok
2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.119:8089       ok
2023-08-18 19:13:32,639 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.206:8089       ok
2023-08-18 19:13:32,778 fetch.py[line:47] ERROR ProxyFetch - freeProxy01: error
2023-08-18 19:13:32,778 fetch.py[line:48] ERROR list index out of range
2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 114.102.47.174:8089     ok
2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 8.130.39.117:8080       ok
2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 122.9.131.161:3128      ok
2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 117.50.175.254:7890     ok
2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 183.164.242.54:8089     ok
2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 36.138.56.214:3128      ok
2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 180.119.93.73:8089      ok
2023-08-18 19:13:33,029 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 139.224.56.162:1234     ok
2023-08-18 19:13:33,029 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 183.164.243.156:8089    ok
2023-08-18 19:13:33,029 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 183.164.243.161:8089    ok
2023-08-18 19:13:33,430 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.57.92.68:8089       ok
2023-08-18 19:13:33,430 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 183.165.227.182:8089    ok
2023-08-18 19:13:33,431 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 111.224.11.146:8089     ok
2023-08-18 19:13:33,431 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.69.237.191:8089     ok
2023-08-18 19:13:33,431 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 125.79.51.242:8089      ok
2023-08-18 19:13:33,432 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 39.100.120.200:7890     ok
2023-08-18 19:13:33,432 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.71.154.168:8089     ok
2023-08-18 19:13:33,432 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 39.165.0.137:9002       ok
2023-08-18 19:13:33,433 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.40.176.42:9091      ok
2023-08-18 19:13:33,433 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.27.186.40:8089      ok
2023-08-18 19:13:33,433 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 60.12.168.114:9002      ok
2023-08-18 19:13:33,434 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 82.156.152.73:7890      ok
2023-08-18 19:13:33,434 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 180.120.212.179:8089    ok
2023-08-18 19:13:33,434 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 114.102.44.112:8089     ok
2023-08-18 19:13:33,434 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.71.149.54:8089      ok
2023-08-18 19:13:33,435 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 49.71.144.162:8089      ok
2023-08-18 19:13:33,435 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.57.92.63:8089       ok
2023-08-18 19:13:33,435 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 36.158.107.38:8085      ok
2023-08-18 19:13:33,435 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 218.28.98.229:9091      ok
2023-08-18 19:13:33,436 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 49.86.181.2:8089        ok
2023-08-18 19:13:33,436 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 114.102.44.43:8089      ok
2023-08-18 19:13:33,437 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 27.158.127.19:8089      ok
2023-08-18 19:13:33,437 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.86.12.19:8089       ok
2023-08-18 19:13:33,437 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 180.121.128.137:8089    ok
2023-08-18 19:13:33,437 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 36.6.145.71:8089        ok
2023-08-18 19:13:33,437 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 183.89.109.208:8080     ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 162.223.94.163:80       ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 178.130.113.251:8080    ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.134.211:8080     ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.74.127:8080      ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 154.236.191.49:1981     ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 27.76.11.251:4007       ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 104.129.194.104:8800    ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.210.47:8080      ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.205.123:8080     ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 103.167.134.31:80       ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 110.238.46.127:8080     ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 178.218.43.60:4411      ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 193.15.14.198:80        ok
2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 27.79.214.140:4002      ok
2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 116.203.28.43:80        ok
2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.3.82:8080        ok
2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 20.115.144.82:80        ok
2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 154.118.228.212:80      ok
2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 185.178.47.135:80       ok
2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.207.146:8080     ok
2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 46.35.90.27:8080        ok
2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 110.78.114.161:8080     ok
2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 94.26.199.226:8080      ok
2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 158.69.53.132:9300      ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.98:8089        ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.144:8089       ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.194:8089       ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.220:8089       ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 114.231.46.233:8888     ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.148:8089       ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.106:8089       ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 223.247.46.96:8089      ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.161:8089       ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 114.231.8.167:8089      ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 121.4.138.93:3128       ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.124:8089       ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.250:8089       ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.119:8089       ok
2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.206:8089       ok
2023-08-18 19:13:33,741 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 60.205.132.71:80        ok
2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 61.216.185.88:60808     ok
2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 113.121.44.194:9999     ok
2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 183.247.221.119:30001   ok
2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 112.243.230.6:9000      ok
2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 61.164.39.69:53281      ok
2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 182.34.20.197:9999      ok
2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 61.164.39.67:53281      ok
2023-08-18 19:13:33,743 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 60.170.204.30:8060      ok
2023-08-18 19:13:33,743 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 61.216.156.222:60808    ok
2023-08-18 19:13:33,743 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 182.34.26.49:9999       ok
2023-08-18 19:13:33,743 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 183.64.239.19:8060      ok
2023-08-18 19:13:34,037 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 124.202.206.94:9091     ok
2023-08-18 19:13:34,037 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 123.154.237.1:8085      ok
2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 120.202.128.112:9002    ok
2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 112.51.96.118:9091      ok
2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 218.75.102.198:8000     ok
2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 114.113.116.67:9091     ok
2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 112.194.142.135:9091    ok
2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 222.170.15.122:9091     ok
2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 47.100.201.85:80        ok
2023-08-18 19:13:34,039 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 39.165.0.137:9002       ok
2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 47.90.[126](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:127).138:9090      ok
2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 114.231.42.64:8888      ok
2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 122.136.212.132:53281   ok
2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 117.26.41.218:8888      ok
2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 118.190.244.234:3128    ok
2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 221.122.91.65:80        ok
2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 60.182.197.86:8888      ok
2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 60.182.35.230:8888      ok
2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 117.157.197.18:3128     ok
2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 118.163.13.200:8080     ok
2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 223.70.126.84:3128      ok
2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 112.250.107.37:53281    ok
2023-08-18 19:13:38,425 webRequest.py[line:80] ERROR requests: http://www.66ip.cn/ error: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2023-08-18 19:13:38,425 webRequest.py[line:86] INFO retry 5 second after
启动webApi服务

****************************************************************
*** ______  ********************* ______ *********** _  ********
*** | ___ \_ ******************** | ___ \ ********* | | ********
*** | |_/ / \__ __   __  _ __   _ | |_/ /___ * ___  | | ********
*** |  __/|  _// _ \ \ \/ /| | | ||  __// _ \ / _ \ | | ********
*** | |   | | | (_) | >  < \ |_| || |  | (_) | (_) || |___  ****
*** \_|   |_|  \___/ /_/\_\ \__  |\_|   \___/ \___/ \_____/ ****
****                       __ / /                          *****
************************* /___ / *******************************
*************************       ********************************
****************************************************************

2023-08-18 19:13:40,781 launcher.py[line:45] INFO ProxyPool Version: 2.4.0
2023-08-18 19:13:40,783 launcher.py[line:50] INFO ProxyPool configure HOST: 0.0.0.0
2023-08-18 19:13:40,784 launcher.py[line:51] INFO ProxyPool configure PORT: 5010
2023-08-18 19:13:40,785 launcher.py[line:52] INFO ProxyPool configure PROXY_FETCHER: ['freeProxy01', 'freeProxy02', 'freeProxy03', 'freeProxy04', 'freeProxy05', 'freeProxy06', 'freeProxy07', 'freeProxy08', 'freeProxy09', 'freeProxy10', 'freeProxy11']
2023-08-18 19:13:40,992 launcher.py[line:58] INFO ============ DATABASE CONFIGURE ================
2023-08-18 19:13:40,993 launcher.py[line:59] INFO DB_TYPE: REDIS
2023-08-18 19:13:40,994 launcher.py[line:60] INFO DB_HOST: [127](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:128).0.0.1
2023-08-18 19:13:40,994 launcher.py[line:61] INFO DB_PORT: 6379
2023-08-18 19:13:40,994 launcher.py[line:62] INFO DB_NAME: 0
2023-08-18 19:13:40,995 launcher.py[line:63] INFO DB_USER: 
2023-08-18 19:13:40,995 launcher.py[line:64] INFO =================================================
[2023-08-18 19:13:41 +0000] [2288] [INFO] Starting gunicorn 19.9.0
[2023-08-18 19:13:41 +0000] [2288] [INFO] Listening at: http://0.0.0.0:5010 (2288)
[2023-08-18 19:13:41 +0000] [2288] [INFO] Using worker: sync
/opt/hostedtoolcache/Python/3.10.12/x64/lib/python3.10/os.py:1030: RuntimeWarning: line buffering (buffering=1) isn't supported in binary mode, the default buffer size will be used
  return io.open(fd, mode, buffering, encoding, *args, **kwargs)
[2023-08-18 19:13:41 +0000] [2290] [INFO] Booting worker with pid: 2290
[2023-08-18 19:13:41 +0000] [2291] [INFO] Booting worker with pid: 2291
[2023-08-18 19:13:41 +0000] [2292] [INFO] Booting worker with pid: 2292
[2023-08-18 19:13:41 +0000] [2293] [INFO] Booting worker with pid: 2293
2023-08-18 19:13:41,919 webRequest.py[line:80] ERROR requests: https://www.89ip.cn/index_1.html error: HTTPSConnectionPool(host='www.89ip.cn', port=443): Max retries exceeded with url: /index_1.html (Caused by ConnectTimeoutError(<urllib3.connection.VerifiedHTTPSConnection object at 0x7fb1d8f513f0>, 'Connection to www.89ip.cn timed out. (connect timeout=10)'))
2023-08-18 19:13:41,919 webRequest.py[line:86] INFO retry 5 second after
[2023-08-18 19:13:43,812][test_proxy.py][DEBUG][36]: 0
[2023-08-18 19:13:43,814][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010
[2023-08-18 19:13:43,820][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /get/ HTTP/1.1" [200](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:201) 28
127.0.0.1 - [18/Aug/[202](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:203)3:19:13:43 +0000] "GET /get/ HTTP/1.1" 200 "python-requests/2.20.0"
[2023-08-18 19:13:43,821][test_proxy.py][DEBUG][21]: None
[2023-08-18 19:13:43,822][connectionpool.py][DEBUG][[204](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:205)]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,831][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,838][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,846][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,854][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,860][test_proxy.py][DEBUG][31]: 0
[2023-08-18 19:13:43,862][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010
[2023-08-18 19:13:43,868][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /delete/?proxy=None HTTP/1.1" 200 19
127.0.0.1 - [18/Aug/2023:19:13:43 +0000] "GET /delete/?proxy=None HTTP/1.1" 200 "python-requests/2.20.0"
[2023-08-18 19:13:43,868][test_proxy.py][DEBUG][38]: None
[2023-08-18 19:13:43,868][test_proxy.py][DEBUG][36]: 1
[2023-08-18 19:13:43,869][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010
[2023-08-18 19:13:43,875][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /get/ HTTP/1.1" 200 28
127.0.0.1 - [18/Aug/2023:19:13:43 +0000] "GET /get/ HTTP/1.1" 200 "python-requests/2.20.0"
[2023-08-18 19:13:43,876][test_proxy.py][DEBUG][21]: None
[2023-08-18 19:13:43,877][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,885][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,904][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,910][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,915][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,920][test_proxy.py][DEBUG][31]: 0
[2023-08-18 19:13:43,921][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010
[2023-08-18 19:13:43,927][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /delete/?proxy=None HTTP/1.1" 200 19
127.0.0.1 - [18/Aug/2023:19:13:43 +0000] "GET /delete/?proxy=None HTTP/1.1" 200 "python-requests/2.20.0"
[2023-08-18 19:13:43,928][test_proxy.py][DEBUG][38]: None
[2023-08-18 19:13:43,928][test_proxy.py][DEBUG][36]: 2
[2023-08-18 19:13:43,929][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010
[2023-08-18 19:13:43,930][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /get/ HTTP/1.1" 200 28
127.0.0.1 - [18/Aug/2023:19:13:43 +0000] "GET /get/ HTTP/1.1" 200 "python-requests/2.20.0"
[2023-08-18 19:13:43,931][test_proxy.py][DEBUG][21]: None
[2023-08-18 19:13:43,932][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,946][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,951][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,957][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,962][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80
[2023-08-18 19:13:43,968][test_proxy.py][DEBUG][31]: 0
[2023-08-18 19:13:43,969][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010
[2023-08-18 19:13:43,972][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /delete/?proxy=None HTTP/1.1" 200 19
127.0.0.1 - [18/Aug/2023:19:13:43 +0000] "GET /delete/?proxy=None HTTP/1.1" 200 "python-requests/2.20.0"
[2023-08-18 19:13:43,972][test_proxy.py][DEBUG][38]: None
2023-08-18 19:13:44,321 webRequest.py[line:80] ERROR requests: http://www.66ip.cn/ error: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2023-08-18 19:13:44,[321](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:322) fetch.py[line:47] ERROR ProxyFetch - freeProxy02: error
2023-08-18 19:13:44,321 fetch.py[line:48] ERROR can only parse strings

test_proxy.py

import requests
import logging

log = logging.getLogger("root")
formatter = "[%(asctime)s][%(filename)s][%(levelname)s][%(lineno)d]: %(message)s"
# logging.basicConfig(level=logging.WARN, format=formatter)
logging.basicConfig(level=logging.DEBUG, format=formatter)

def get_proxy():
    return requests.get("http://127.0.0.1:5010/get/").json()

def delete_proxy(proxy):
    requests.get("http://127.0.0.1:5010/delete/?proxy={}".format(proxy))

# your spider code

def getHtml():
    # ....
    retry_count = 5
    proxy = get_proxy().get("proxy")
    log.debug(proxy)
    while retry_count > 0:
        try:
            html = requests.get('http://www.baidu.com', proxies={"http": "http://{}".format(proxy)})
            log.debug(html.status_code)
            # 使用代理访问
            return html
        except Exception:
            retry_count -= 1
    # 删除代理池中代理
    log.debug(retry_count)
    delete_proxy(proxy)
    return None

for i in range(3):
    log.debug(i)
    res = getHtml()
    log.debug(res)
    if res:
        break

来源：https://github.com/jhao104/proxy_pool/issues/763

3条答案

按热度按时间

你这样是因为什么，现在云服务器又不贵甚至又白嫖的

赞(0）回复(0）举报 5个月前

谢谢回复

想实现的功能是定时抓取国内某网站的图片
发现 Github 直连异常，就尝试本项目的代理功能

其次使用 Github Action，我认为的好处

免费
空间大
流量多
自动化
历史版本
网络备份
......

赞(0）回复(0）举报 5个月前

哈哈牛我觉得就算行也不长久这空子不好钻

赞(0）回复(0）举报 5个月前

相关问题

热门标签

Java query python Node 开发语言 request Util 数据库 Table 后端算法 Logger Message Element Parser

最新问答

xxl-job 安全组扫描到执行器端口服务存在信息泄露漏洞
回答(1) 发布于 4个月前
xxl-job 不能和nacos兼容？
回答(3) 发布于 4个月前
xxl-job 任务执行完后无法结束，日志一直转圈
回答(3) 发布于 4个月前
xxl-job-admin页面上查看调度日志样式问题
回答(1) 发布于 4个月前
xxl-job 参数512字符限制能否去掉
回答(1) 发布于 4个月前