惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Spread Privacy
Spread Privacy
T
Threatpost
L
LINUX DO - 热门话题
Google Online Security Blog
Google Online Security Blog
I
InfoQ
大猫的无限游戏
大猫的无限游戏
博客园_首页
爱范儿
爱范儿
有赞技术团队
有赞技术团队
V
Visual Studio Blog
D
Darknet – Hacking Tools, Hacker News & Cyber Security
酷 壳 – CoolShell
酷 壳 – CoolShell
P
Privacy International News Feed
C
Cyber Attacks, Cyber Crime and Cyber Security
Jina AI
Jina AI
博客园 - 聂微东
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
C
CERT Recently Published Vulnerability Notes
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
aimingoo的专栏
aimingoo的专栏
P
Proofpoint News Feed
K
Kaspersky official blog
L
LangChain Blog
G
GRAHAM CLULEY
B
Blog RSS Feed
G
Google Developers Blog
Google DeepMind News
Google DeepMind News
The Cloudflare Blog
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
A
About on SuperTechFans
阮一峰的网络日志
阮一峰的网络日志
Last Week in AI
Last Week in AI
T
Tailwind CSS Blog
Cyberwarzone
Cyberwarzone
C
Cybersecurity and Infrastructure Security Agency CISA
P
Proofpoint News Feed
Help Net Security
Help Net Security
S
Security @ Cisco Blogs
Cloudbric
Cloudbric
雷峰网
雷峰网
C
Check Point Blog
MongoDB | Blog
MongoDB | Blog
NISL@THU
NISL@THU
L
Lohrmann on Cybersecurity
Vercel News
Vercel News
T
Tor Project blog
T
The Exploit Database - CXSecurity.com
T
Troy Hunt's Blog
W
WeLiveSecurity
T
Threat Research - Cisco Blogs

博客园 - 水手paul2008

MySQL 数据库归档日志相关 SQL Server 数据库给第三方用户开权限,限制可见内容。 visual svn server 迁移 windbg preview调试winform程序卡死 JavaScript的数字运算不准的问题 .net List.ForEach内部Async/Await 异步的问题 SQLServer数据库优化 windbg 调试 winform程序(二车间机台程序) IIS日志分析工具 .Net的三个Timer内Interval是不精确的 IE 碰到<不能执行已释放 Script 的代码> IIS应用程序池设置若干 关于thinkpad t440s的声卡失真问题,竟然带来对旧电脑的惊喜 ArcMap10.4 遇到严重的应用程序错误,无法继续 给汽车换牌照灯的故事 .Net 混淆器ConfuserEx 车辆年检、强险、车船税的关系 .Net下几种ORM Windows 刷新图标命令
asp.net core 大并发设置
水手paul2008 · 2023-09-08 · via 博客园 - 水手paul2008

因为看到https://learn.microsoft.com/en-us/archive/msdn-magazine/2014/october/async-programming-introduction-to-async-await-on-asp-net,文章说异步IO,数据库不消耗线程,故做个测试,结果似乎没看出来异步是否比同步更少消耗线程。可能测试样例不对。但测试出大并发下改如何设置,也算有收获,在此记录。

现在新的.net webapi其实不用asp.net 4的应用程序池,都是“无托管代码”。故,设置IIS并没多大意义。

主要是程序设置:

首先,也是最重要的,ThreadPool.SetMinThreads(work, io);work设置1000,io没有影响设置原先值即可。默认work值是CPU逻辑核数,当请求的并发大时就报502错误,或者线程池开始排队(有Queen值)。

其次,若数据库处理速度很快,则设置.Net数据库连接池MaxSize。我这是SqlServer:Pooling=true;Min pool size=5;Max pool size=1024;Connect Timeout=100。Max pool size影响最大,默认是100。其中,平衡要掌握好。当线程池线程数大于数据库连接池最大数时,将报数据库连接池不足错误( Connection open error . Timeout expired.  The timeout period elapsed prior to obtaining a connection from the pool.  This may have occurred because all pooled connections were in use and max pool size was reached)。

开始测试

代码如下。一个同步,一个异步,两个方法。都执行数据库存储过程,数据库是SqlServer,存储过程等到10秒。 

using Microsoft.AspNetCore.Http;
using Microsoft.AspNetCore.Mvc;
using Microsoft.Data.SqlClient;
using SqlSugar;
using System.Configuration;
using System.Data;

namespace WebApplication2
{
    [Route("api/[controller]")]
    [ApiController]
    public class ValuesController : ControllerBase
    {
        private readonly IConfiguration _configuration;
        public ValuesController(IConfiguration configuration)
        {
            _configuration = configuration;
        }

        [HttpGet]
        public IActionResult Get()
        {
            return new OkObjectResult(DateTime.Now.ToString());
        }

        [HttpGet("Sync")]
        public IActionResult GetSync()
        {
            string msg = "";
            string? connStr = _configuration.GetValue<string>("DbConfig:ConnectionString");
            using (SqlSugarClient client = new SqlSugarClient(new ConnectionConfig()
            {
                ConnectionString = connStr,
                DbType = SqlSugar.DbType.SqlServer,

            }))
            {
                msg = Thread.CurrentThread.ManagedThreadId.ToString();
                DataSet ds = client.Ado.UseStoredProcedure().GetDataSetAll("TestWait");
                msg += " " + Thread.CurrentThread.ManagedThreadId.ToString();
            }
            return new OkObjectResult(msg + " " + DateTime.Now.ToString());
        }

        [HttpGet("Async")]
        public async Task<IActionResult> GetAsync()
        {
            string msg = "";
            string? connStr = _configuration.GetValue<string>("DbConfig:ConnectionString");
            using (SqlSugarClient client = new SqlSugarClient(new ConnectionConfig()
            {
                ConnectionString = connStr,
                DbType = SqlSugar.DbType.SqlServer,
            }))
            {
                msg = Thread.CurrentThread.ManagedThreadId.ToString();
                DataSet ds = await client.Ado.UseStoredProcedure().GetDataSetAllAsync("TestWait");
                msg += " " + Thread.CurrentThread.ManagedThreadId.ToString();
            }
            return new OkObjectResult(msg + " " + DateTime.Now.ToString());
        }
    }
}

View Code

 存储过程如下:TestWait

SET QUOTED_IDENTIFIER ON
SET ANSI_NULLS ON
GO
 
CREATE PROC TestWait
AS 
BEGIN

SELECT GETDATE()
WAITFOR DELAY N'00:00:10'
SELECT GETDATE()

END 
GO

View Code

JMeter压测,dotnet-counters监控(https://learn.microsoft.com/zh-cn/dotnet/core/diagnostics/dotnet-counters)

1、发出测试,1000个1秒内发送。

2、监控线程池。 .\dotnet-counters.exe monitor -p 10580 --counters Microsoft.AspNetCore.Hosting,System.Runtime

看到线程池排大队,但线程池由于爬坡算法,不会迅速增加线程,故导致很多http返回502。

 而且实际非常长,将近4分钟。

修改程序参数,再测试:

1、Main内设置参数,ThreadPool.SetMinThreads(1000, 10);

2、 同时,连接字符串添加如下:Pooling=true;Min pool size=5;Max pool size=1024;Connect Timeout=100

3,看结果。存储过程等待10秒,表现非常不错99%都在21秒内返回,web的紧箍咒解掉了,压力都传入后端数据库。