惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Cyberwarzone
Cyberwarzone
Recent Announcements
Recent Announcements
D
DataBreaches.Net
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
博客园 - 聂微东
博客园 - 【当耐特】
aimingoo的专栏
aimingoo的专栏
N
Netflix TechBlog - Medium
V
Visual Studio Blog
The GitHub Blog
The GitHub Blog
Blog — PlanetScale
Blog — PlanetScale
Engineering at Meta
Engineering at Meta
L
LangChain Blog
The Cloudflare Blog
Y
Y Combinator Blog
AI
AI
P
Palo Alto Networks Blog
美团技术团队
有赞技术团队
有赞技术团队
I
Intezer
Last Week in AI
Last Week in AI
Know Your Adversary
Know Your Adversary
D
Darknet – Hacking Tools, Hacker News & Cyber Security
NISL@THU
NISL@THU
博客园 - 三生石上(FineUI控件)
MongoDB | Blog
MongoDB | Blog
S
Schneier on Security
IT之家
IT之家
博客园 - 司徒正美
A
Arctic Wolf
罗磊的独立博客
雷峰网
雷峰网
Vercel News
Vercel News
SecWiki News
SecWiki News
AWS News Blog
AWS News Blog
GbyAI
GbyAI
WordPress大学
WordPress大学
cs.AI updates on arXiv.org
cs.AI updates on arXiv.org
T
Tor Project blog
V
Vulnerabilities – Threatpost
Hugging Face - Blog
Hugging Face - Blog
H
Heimdal Security Blog
Schneier on Security
Schneier on Security
H
Help Net Security
T
Troy Hunt's Blog
N
News and Events Feed by Topic
爱范儿
爱范儿
V2EX - 技术
V2EX - 技术
Project Zero
Project Zero
T
The Exploit Database - CXSecurity.com

jdhao's digital space

Conversion between base64 and OpenCV or PIL Image 腾讯云对象存储博客图床开启 CDN 加速(不需要购买额外域名) Search and Replace in Multiple Files in Vim/Neovim Change Table Column Width in LaTeX Image or Table Side by Side in LaTeX LaTeX 并排显示图像或表格 Firenvim: Neovim inside Your Browser Content inside HTML tags missing in Latest Hugo? Creating Markdown Front Matter with Ultisnips Labelme JSON 标注格式转 voc XML 格式 Nifty Nvim Techniques That Make My Life Easier -- Series 6 macOS 下如何为视频制作字幕 Running Command Asynchronously inside Neovim Resolving Merge Conflict after Git Stash Pop Pylint: command not found? A Hands-on Experience with Neovim's Built-in LSP Support How to Convert PDF to Images with Imagemagick 互联网上常用缩略语集锦 File Backup in Neovim Converting PDF Pages to Images with Poppler Nifty Nvim Techniques That Make My Life Easier -- Series 5 Neovim Configuration for System-wide Use How to sort a list of tuple or list in Python -- lambda or itemgetter? Building A Vim Statusline from Scratch 人类第一颗原子弹爆炸始末 Distributed Training in PyTorch with Horovod Learning Expect Programming Essential Knowledge about SSH Nifty LaTeX Techniques -- Series 1 更改 Adsense 邮寄地址,重新寄送 PIN Mintty Tips and Configurations Generating Table of Contents for Markdown with Tagbar Convert Python Script to Exe on Windows with Pyinstaller Ubuntu on Windows Missing after Windows Update 使用代理加速 Mac 终端下载速度 My Experience with Several Zsh Plugin Managers 深圳租房小记 How to Install zplug inside Docker Container Why don't settings inside bashrc or bash_profile take effect? Setting Up Locale in Linux 谷歌 Adsense 申请及在 Hugo 中的配置 How to Write Algorithm Pseudo Code in LaTeX Nifty Nvim Techniques That Make My Life Easier -- Series 4 A Few Grammar Questions in Writing How to Read and Write Images with Unicode Paths in OpenCV Creating A Professional Table in LaTeX with booktabs How to Create Proper Folding for Vim/Nvim Configuration Linux Tips and Tricks -- s1 JPEG Image Orientation and Exif How Do I Show the Current File Path In Neovim? JPEG Image Quality in PIL Difference between view, reshape, transpose and permute in PyTorch Convert PIL or OpenCV Image to Bytes without Saving to Disk Fast Movement and Navigation Inside Vim or Neovim Unintuitive Behaviour of Case Sensitivity in Python glob Binding Keys in Zsh 几把机械键盘试用体验 Nvim Autocompletion with Deoplete Converting Markdown to Beautiful PDF with Pandoc Exclusive and Inclusive Motion in Neovim/Vim Nifty Nvim Techniques Which Make My Life Easier -- Series 3 Why Doesn't Jedi Autocompletion Work for Some Methods Vim-like Editing inside Browser Markdown 生成 HTML 时汉字之间出现多余空格问题 小米 9 安装谷歌商店(Google Play Store)与相关配置 Create Mappings That Take A Count in Neovim Spell Checking in Nvim English Words Completion inside Neovim/Vim How to Use Python Inside Vim Script with Neovim Nifty Little Nvim Techniques to Make My Life Easier -- Series 2 Setting up Ultisnips for Neovim Mac 上罗技 M590 鼠标设置 Nifty Little Nvim Techniques to Make My Life Easier -- Series 1 A Complete Guide on Writing LaTeX with Vimtex in Neovim Manipulating Images with Alpha Channels in Pillow Sublime Text Regular Expression Cheat Sheet Cropping Rotated Rectangles from Image with OpenCV Boosting Your Productivity on Terminal with Zsh and Plugins 最新版 Rime 输入法使用 (2022 更新) Display Image with Pillow inside Ubuntu on Windows Faster Directory Navigation with z.lua Cmder Advanced Configurations Nvim-qt Settings on Windows 10 Tmux Plugin Install and Management How to Debug Python Code in Terminal Markdown Writing and Previewing in Neovim -- A Complete Guide Line Number Settings for More Efficient Movement in Neovim 两个大规模中文语料库介绍以及处理 Windows 系统下几款程序员不可不用的神器 我的 2018 阅读清单 A Complete Guide to Neovim Configuration for Python Development How Is Newline Handled in Python and Various Editors? Two Issues Related to ImageFont Module in PIL 在 Listary 中调用 GoldenDict 或欧路词典查单词 Reading and Writing Text Files on Windows The Mathematics behind Font Shapes --- Bézier Curves and More 快速识别图片字体:字体识别工具介绍 Deoplete Failed to Load at Startup after Updating Python neovim Package What Is The Difference between pip, pip3 and pip3.6 Shipped with Anaconda3? Windows 10 系统下 Neovim 安装与配置
uWSGI Install and Use Issues
2020-07-02 · via jdhao's digital space

My notes on several issues when installing and running uWSGI.

pip install uwsgi error#

When I try to install uwsgi using pip, there are compilation errors. After some search, based on discussions here, I find the cause of this issue is that the version of gcc is too high. I am using Ubuntu 18.04, and the default gcc version is 7.4.0.

Based on this post, the minimum gcc we can install from the default Ubuntu 18.04 remote repo is gcc-4.8. There is no gcc-4.7 available for install. It turns out that gcc-4.8 works fine:

apt-get update && apt-get install gcc-4.8 g++-4.8

Then we need to change the gcc command to point to gcc-4.8:

rm /usr/bin/gcc && ln -s /usr/bin/gcc-4.8 /usr/bin/gcc

After that, I can install uwsgi successfully using pip. Finally, let’s revert the gcc version to its old state:

rm /usr/bin/gcc && ln -s /usr/bin/gcc-7 /usr/bin/gcc

uwsgi can not find shared object#

I use the following command to install uwsgi with conda:

conda create -n py36 -c conda-forge python==3.6.5 uwsgi

When I run uwsgi --version, I see the following error message:

error while loading shared libraries: libicui18n.so.58: cannot open shared object file: No such file or directory

The solution is to run conda install icu=58, ref here.

uwsgi segmentation fault#

I am using uwsgi 2.0.18 (installed via conda install -c conda-forge uwsgi) with python 3.7.7 from Miniconda. When I use uwsgi to server a simple Flask application, I see segmentation errors below:

uwsgi(uwsgi_backtrace+0x2c) [0x5638f8685bbc]
uwsgi(uwsgi_segfault+0x32) [0x5638f8685ff2]
/lib/x86_64-linux-gnu/libc.so.6(+0x3ef20) [0x7f8c09c22f20]
/opt/miniconda/lib/python3.7/lib-dynload/_queue.cpython-37m-x86_64-linux-gnu.so(+0x2932) [0x7f8c07fe9932]
uwsgi(_PyDict_DelItem_KnownHash+0x36b) [0x5638f860ec1b]
uwsgi(_PyEval_EvalFrameDefault+0x2510) [0x5638f85a1680]
uwsgi(_PyEval_EvalCodeWithName+0x2f9) [0x5638f862abc9]
uwsgi(_PyFunction_FastCallDict+0x1d7) [0x5638f86045a7]
uwsgi(+0x1ed7a3) [0x5638f86057a3]
uwsgi(PyObject_CallFunctionObjArgs+0x99) [0x5638f8605a09]
uwsgi(PyObject_ClearWeakRefs+0x33c) [0x5638f86010fc]
uwsgi(+0x1a638c) [0x5638f85be38c]
uwsgi(+0x1b9a27) [0x5638f85d1a27]
uwsgi(+0x1f70b8) [0x5638f860f0b8]
uwsgi(+0x1a6435) [0x5638f85be435]
uwsgi(_PyFunction_FastCallKeywords+0x290) [0x5638f8604020]
uwsgi(_PyEval_EvalFrameDefault+0x40a) [0x5638f859f57a]
uwsgi(_PyFunction_FastCallDict+0x10b) [0x5638f86044db]
uwsgi(_PyEval_EvalFrameDefault+0x1e1d) [0x5638f85a0f8d]
uwsgi(_PyFunction_FastCallKeywords+0xfb) [0x5638f8603e8b]
uwsgi(_PyEval_EvalFrameDefault+0x6d4) [0x5638f859f844]
uwsgi(_PyFunction_FastCallKeywords+0xfb) [0x5638f8603e8b]
uwsgi(_PyEval_EvalFrameDefault+0x6d4) [0x5638f859f844]
uwsgi(_PyFunction_FastCallKeywords+0xfb) [0x5638f8603e8b]
uwsgi(_PyEval_EvalFrameDefault+0x6d4) [0x5638f859f844]
uwsgi(_PyFunction_FastCallDict+0x10b) [0x5638f86044db]
uwsgi(_PyObject_Call_Prepend+0x63) [0x5638f86054b3]
uwsgi(+0x1b56fa) [0x5638f85cd6fa]
uwsgi(PyObject_Call+0x6b) [0x5638f8604bdb]
uwsgi(python_call+0x12) [0x5638f869ffa2]
uwsgi(uwsgi_request_wsgi+0x266) [0x5638f86a2556]
uwsgi(wsgi_req_recv+0xa7) [0x5638f8633557]
uwsgi(simple_loop_run+0xd1) [0x5638f8681521]
uwsgi(simple_loop+0x11) [0x5638f8681301]
uwsgi(uwsgi_ignition+0x315) [0x5638f8686395]
uwsgi(uwsgi_worker_run+0x2b4) [0x5638f868aef4]
uwsgi(uwsgi_run+0x525) [0x5638f868b575]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f8c09c05b97]
uwsgi(+0x21abed) [0x5638f8632bed]
*** end of backtrace ***

My MWE flask application:

import concurrent.futures

from flask import Flask

app = Flask(__name__)

@app.route("/toy", methods=["GET"])
def process_request():
    results = do_concurrent()

    if not results:
        return "Fail."

    return "Success"


def simple_task(num):
    return 1


def do_concurrent():
    dummy_list = list(range(100))
    with concurrent.futures.ThreadPoolExecutor(max_workers=10) as executor:
        results = list(executor.map(simple_task, dummy_list))

    return results

The uwsgi command to run flask application:

uwsgi --http 0.0.0.0:6012 --wsgi-file flask_demo.py --callable app --processes 1 --threads 1

The scrip to test this service:

import requests


url = "http://0.0.0.0:6012/toy"

r = requests.get(url, timeout=5)
print(r)

When I request the service, I see the above segmentation errors.

If I create a conda virtual env with python version 3.6:

conda create -n py36 -c conda-forge python==3.6.5 uwsgi icu=58 flask

run the service using uwsgi and request again, the error disappears.

If I do not use concurrent.futures, I see no errors both for python 3.7 and python 3.6. I am not knowledgeable enough to know the exact cause of this issue. It seems there is some compatibility issue with uwsgi, python version and concurrent package.

symbol not found on macOS#

I am using Python 3.7 installed via Anaconda, and uWSGI is installed via pip. When I run my simple Flask application, I see the following error:

ImportError: dlopen(/Users/jdhao/anaconda3/lib/python3.7/lib-dynload/math.cpython-37m-darwin.so, 2): Symbol not found: _PyExc_MemoryErrorImportError: dlopen(/Users/jdhao/anaconda3/lib/python3.7/lib-dynload/math.cpython-37m-darwin.so, 2): Symbol not found: _PyExc_MemoryError
  Referenced from: /Users/jdhao/anaconda3/lib/python3.7/lib-dynload/math.cpython-37m-darwin.so
  Expected in: flat namespace

This seems to be a compatibility issue between uWSGI and Anaconda python. There are two solutions:

  1. Uninstall uWSGI installed via pip and install it using conda:

    # uWSGI is provided by the conda-forge channel
    conda install -c conda-forge uwsgi
  2. Using Python 3.6 with uWSGI. We can create a new virtual env with Python 3.6.5 and intall uWSGI inside.

    conda create -n py36 python==3.6.5 flask

    After that, activate the virtual env and install uWSGI inside:

    conda activate py36
    pip install uwsgi