zoukankan      html  css  js  c++  java
  • socket listen backlog

    http://stackoverflow.com/questions/4253454/question-about-listening-and-backlog-for-sockets

    The listen backlog is, as Pieter said, a queue which is used by the operating system to store connections that have been accepted by the TCP stack but not, yet, by your program.

    Conceptually, when a client connects it's placed in this queue until your Accept() code removes it and hands it to your program.

    As such, the listen backlog is a tuning parameter调优参数 that can be used to help your server handle peaks峰值 in concurrent connection attempts.

    Note that this is concerned with peaks in concurrent connection attempts and in no way related to the maximum number of concurrent connections that your server can maintain.

    For example, if you have a server which receives 10 new connections per second then it's unlikely that tuning the listen backlog will have any affect even if these connections are long lived

    and your server is supporting 10,000 concurrent connections (assuming your server isn't maxing out the CPU serving the existing connections!).

    However, if a server occasionally experiences short periods when it is accepting 1000 new connections per second then you can probably prevent some connections from being rejected

    by tuning the listen backlog to provide a larger queue and therefore give your server more time to call Accept() for each connection.

    As for pros优点 and cons缺点, well the pros are that you can handle peaks in concurrent connection attempts better and the corresponding con is that the operating system needs to allocate more space for the listen backlog queue because it is larger. So it's a performance vs resources trade off权衡.

    Personally I make the listen backlog something that can be externally tuned via a config file.

    How and when you call listen and accept depends upon the style of sockets code that you're using.

    With synchronous code you'd call Listen() once with a value, say 10, for your listen backlog and then loop calling Accept().

    The call to listen sets up the end point that your clients can connect to and conceptually creates the listen backlog queue of the size specified.

    Calling Accept() removes a pending connection from the listen backlog queue, sets up a socket for application use and passes it to your code as a newly established connection.

    If the time taken by your code to call Accept(), handle the new connection, and loop round to call Accept() again is longer than the gap间隙 between concurrent connection attempts

    then you'll start to accumulate累加 entries登记 in the listen backlog queue.

    With asynchronous sockets it can be a little different, if you're using async accepts you will listen once, as before and then post several (again configurable) async accepts.

    As each one of these completes you handle the new connection and post a new async accept.

    In this way you have a listen backlog queue and a pending accept 'queue' and so you can accept connections faster

    (what's more the async accepts are handled on thread pool threads so you don't have a single tight accept loop).

    This is, usually, more scalable and gives you two points to tune to handle more concurrent connection attempts.

  • 相关阅读:
    重建二叉树
    数值的整数次方
    二维数组查找
    二进制中1的个数
    LRU算法的精简实现(基于Java)
    华为18.9.5校招笔试题AK
    避免反射和序列化来破坏单例
    Markdown图片存储解决方法-利用阿里云OSS
    基于Java反射的map自动装配JavaBean工具类设计
    多态与类初始化的底层原理
  • 原文地址:https://www.cnblogs.com/chucklu/p/5253765.html
Copyright © 2011-2022 走看看