• 技术文章 >Python技术 >Python爬虫

    利用Python对网站进行测速

    PythonPython2019-06-20 10:27:13原创5554
    利用python可以编写的用于测试网站访问速率的代码，实现原理是输出打开某url的时间，并计算出访问100次的平均时间，时间和最小时间等等。根据时间的变化判断网站速度。

    完整代码：

    1

    2

    3

    4

    5

    6

    7

    8

    9

    10

    11

    12

    13

    14

    15

    16

    17

    18

    19

    20

    21

    22

    23

    24

    25

    26

    27

    28

    29

    import urllib2

    from datetime import *

    import time

    def Process(url,n):

      minSpan = 10.0

      maxSpan = 0.0

      sumSpan= 0.0

      over1s = 0

      for i in range(n):

        startTime = datetime.now()

        try:

          res = urllib2.urlopen(url,timeout=10)

        except:

          pass

        endTime = datetime.now()

        span = (endTime-startTime).total_seconds()

        sumSpan = sumSpan + span

        if span < minSpan:

          minSpan = span

        if span > maxSpan:

          maxSpan = span

        #超过一秒的

        if span>1:

          over1s=over1s + 1

        print(u'%s Spent :%s seconds'%(url,span))

      print(u'requested:%s times,Total Spent:%s seconds,avg:%s seconds, max:%s seconds,min:%s seconds,over 1 secnod:%s times'%(n,sumSpan,sumSpan/n,maxSpan,minSpan,over1s))

      print('\n')

    if __name__=='__main__':

      Process('http://www.baidu.com',100)

    运行结果如下：

    1

    2

    3

    4

    5

    6

    7

    8

    9

    10

    11

    12

    13

    14

    15

    16

    17

    18

    19

    20

    21

    22

    23

    24

    25

    26

    27

    28

    29

    30

    31

    32

    33

    34

    35

    36

    37

    38

    39

    40

    41

    42

    43

    44

    45

    46

    47

    48

    49

    50

    51

    52

    53

    54

    55

    56

    57

    58

    59

    60

    61

    62

    63

    64

    65

    66

    67

    68

    69

    70

    71

    72

    73

    74

    75

    76

    77

    78

    79

    80

    81

    82

    83

    84

    85

    86

    87

    88

    89

    90

    91

    92

    93

    94

    95

    96

    97

    98

    99

    100

    101

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.094 seconds

    http://www.baidu.com Spent :0.016 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.016 seconds

    http://www.baidu.com Spent :0.015 seconds

    http://www.baidu.com Spent :0.015 seconds

    http://www.baidu.com Spent :0.016 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.046 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.094 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.109 seconds

    http://www.baidu.com Spent :0.094 seconds

    http://www.baidu.com Spent :0.094 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.062 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.047 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.015 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.047 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.016 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.016 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.015 seconds

    http://www.baidu.com Spent :0.016 seconds

    http://www.baidu.com Spent :0.016 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.015 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.078 seconds

    http://www.baidu.com Spent :0.109 seconds

    http://www.baidu.com Spent :0.015 seconds

    http://www.baidu.com Spent :0.094 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.109 seconds

    http://www.baidu.com Spent :0.094 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.047 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.032 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    http://www.baidu.com Spent :0.031 seconds

    requested:100 times,Total Spent:3.67 seconds,avg:0.0367 seconds, max:0.109 seconds,min:0.015 seconds,over 1 secnod:0 times

    专题推荐：python
    上一篇：urllib2能处理post请求吗 下一篇：Python中的opener()方法是什么

    相关文章推荐

    • Python中的zfill()有什么用？• 利用Python的Matplotlib库进行数据可视化• 怎么通过Python获取文件指定行的内容？• Python的监控功能示例

    全部评论我要评论

    © 2021 Python学习网 苏ICP备2021003149号-1

  • 取消发布评论
    • 

    Python学习网

    首页 首页视频视频手册手册图文图文文章文章社区社区