惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

The GitHub Blog
The GitHub Blog
A
About on SuperTechFans
The Cloudflare Blog
G
Google Developers Blog
博客园_首页
Martin Fowler
Martin Fowler
Apple Machine Learning Research
Apple Machine Learning Research
L
LangChain Blog
D
Docker
C
Check Point Blog
T
Tailwind CSS Blog
博客园 - 司徒正美
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
Hugging Face - Blog
Hugging Face - Blog
Microsoft Security Blog
Microsoft Security Blog
V
V2EX
博客园 - 叶小钗
T
The Blog of Author Tim Ferriss
酷 壳 – CoolShell
酷 壳 – CoolShell
IT之家
IT之家
M
MIT News - Artificial intelligence
Microsoft Azure Blog
Microsoft Azure Blog
博客园 - 【当耐特】
GbyAI
GbyAI

jdhao's digital space

Conversion between base64 and OpenCV or PIL Image 腾讯云对象存储博客图床开启 CDN 加速(不需要购买额外域名) Search and Replace in Multiple Files in Vim/Neovim Change Table Column Width in LaTeX Image or Table Side by Side in LaTeX LaTeX 并排显示图像或表格 Firenvim: Neovim inside Your Browser Content inside HTML tags missing in Latest Hugo? Creating Markdown Front Matter with Ultisnips Labelme JSON 标注格式转 voc XML 格式 Nifty Nvim Techniques That Make My Life Easier -- Series 6 macOS 下如何为视频制作字幕 Running Command Asynchronously inside Neovim Resolving Merge Conflict after Git Stash Pop Pylint: command not found? A Hands-on Experience with Neovim's Built-in LSP Support How to Convert PDF to Images with Imagemagick 互联网上常用缩略语集锦 File Backup in Neovim Converting PDF Pages to Images with Poppler Nifty Nvim Techniques That Make My Life Easier -- Series 5 Neovim Configuration for System-wide Use How to sort a list of tuple or list in Python -- lambda or itemgetter? Building A Vim Statusline from Scratch 人类第一颗原子弹爆炸始末 Distributed Training in PyTorch with Horovod Learning Expect Programming Essential Knowledge about SSH Nifty LaTeX Techniques -- Series 1 更改 Adsense 邮寄地址,重新寄送 PIN
Why Cannot I Get the Value of A Env Variable in Python?
2020-07-15 · via jdhao's digital space

I found a strange issue when I wanted to get the value of an env variable from Python script.

To reproduce, we can first set the value of FOO in the Bash shell:

Then execute the following python command:

$ python -c "import os; print(os.getenv('FOO', "None"))"

The output is None. So the python process can not see the variable FOO. However, if we run the two command in one line:

$ FOO=123 python -c "import os; print(os.getenv('FOO', "None"))"

The output will be 123.

If we use export FOO=123 instead of FOO=123, we can also get the value of FOO in Python.

But why? What is the difference here? This is in fact a bit complexer than what I think.

Bash built-in and external commands#

First, we need to know that, when Bash executes commands, it treats the built-in and external commands differently. Built-in commands are those that are, literally, built into the Bash executable. External commands are those commands that are not part of the Bash shell.

When Bash executes built-in commands, it does not create a new process. When it executes external commands, it will create a new shell and then execute the external commands. The new shell will inherit the environment variables of its parent shell (see here on why Bash needs to create a new process to execute an external command).

How do we check if a command is a Bash builtin or an external command?

First, we can check the output of help, it will list all Bash built-in commands. We can also use the type command to check if a command is a built-in command:

For built-in commands, it will output builtin. For external commands, it will output different info, for example, file (see help type for more info).

Ref:

When will variable value be available in a process?#

If we define variable without using export, it is not part of the environment variable. When Bash create a new process, this variable will not be available there.

One exception is that if you set the variable and run the command in the same line, it will be available only to that command. From the Bash manual:

The environment for any simple command or function may be augmented temporarily by prefixing it with parameter assignments, as described in Shell Parameters. These assignment statements affect only the environment seen by that command.

If a variable is not exported, it is only a shell variable. When it is exported, it is an environment variable that will be available in all subprocesses.

Ref:

Back to the issue#

Now with sufficient background knowledge on how Bash works, we are able to understand why certain ways work or fail.

# Fails
$ FOO=123
$ python -c "import os; print(os.getenv('FOO', "None"))"

The above way to get the value of FOO fails, because python is an external command for Bash. Bash will execute python in a new process. However, FOO defined via FOO=123 is only available in the shell that invoking python command, not the sub-process (also a Bash shell) that actually run python command.

# work
$ FOO=123 python -c "import os; print(os.getenv('FOO', "None"))"

The above way works because the variable definition is in the same line with python command. It will be available temporily for this command. If you execute python -c "import os; print(os.getenv('FOO', "None")) in a second line, it will not work any more.

$ export FOO=123
$ python -c "import os; print(os.getenv('FOO', "None"))"

This way also works because we set an environment variable FOO via export. So FOO will be available to all subprocesses created by this shell.

References#