我正在開發(fā)一個使用 CircleCI 持續(xù)集成平臺的項目。我使用 Python 作為主要語言，使用 Miniconda 作為平臺。我想在 CircleCI 上使用 Miniconda 測試多個 Python 和 NumPy 版本。我嘗試使用不同的 Python 映像，但在我安裝最新的 Miniconda 版本時它只使用 Python 3.7。你能告訴我如何使用多個版本嗎？下面是config.yml：version: 2.0workflows: version: 2 test: jobs: - py3.6-np1.15 - py3.5-np1.15 - py3.6-np1.14 - py3.5-np1.14 - py3.7-np1.15 - py3.5-np1.16 - py3.6-np1.16 - py3.7-np1.16jobs: py3.6-np1.15: &test-template docker: - image: circleci/python:3.6.8 environment: NUMPY_VERSION: 1.15.2 CYTHON_VERSION: 0.29.2 working_directory: ~/repo steps: - checkout - run: name: Install System Dependencies command: sudo apt-get update && sudo apt-get install -y libmpich12 libmpich-dev build-essential # Download and cache dependencies - restore_cache: keys: - v1-dependencies-{{ .Environment.CIRCLE_JOB }}-{{ checksum "setup.py" }} - run: name: install anaconda command: | wget https://repo.continuum.io/miniconda/Miniconda3-4.7.10-Linux-x86_64.sh -O ~/miniconda.sh chmod +x ~/miniconda.sh && ~/miniconda.sh -b export PATH=$HOME/miniconda3/bin:$PATH conda update --quiet --yes conda - run: name: Install numpy, cython, mdtraj command: | export PATH=$HOME/miniconda3/bin:$PATH conda install --quiet --yes numpy==$NUMPY_VERSION cython==$CYTHON_VERSION conda install --quiet --yes -c conda-forge mdtraj # - run: # name: Upgrade pip # command: | # python3 -m venv venv # . venv/bin/activate # pip install pip==18.0 # - run: # name: Install numpy and cython # command: | # python3 -m venv venv # . venv/bin/activate # pip install --progress-bar off numpy==$NUMPY_VERSION cython==$CYTHON_VERSION
1 回答
藍(lán)山帝景
TA貢獻(xiàn)1843條經(jīng)驗 獲得超7個贊
這是一個關(guān)于如何將 CircleCI 與 Miniconda 以及特定的 Python 和 NumPy 版本一起使用的最小示例配置，從一個空ubuntu:bionic圖像開始。
version: 2
jobs:
build:
docker:
- image: ubuntu:bionic
environment:
PYTHON_VERSION: 3.5.5
NUMPY_VERSION: 1.14.2
steps:
- checkout
- run:
name: Setup Miniconda
command: |
apt update
apt install -y wget
cd $HOME
wget "https://repo.anaconda.com/miniconda/Miniconda3-4.7.10-Linux-x86_64.sh" -O miniconda.sh
printf '%s' "8a324adcc9eaf1c09e22a992bb6234d91a94146840ee6b11c114ecadafc68121 miniconda.sh" | sha256sum -c
bash miniconda.sh -b -p $HOME/miniconda
- run:
name: Setup environment and run tests
command: |
export PATH="$HOME/miniconda/bin:$PATH"
conda update -y conda
conda create -n myenv python=$PYTHON_VERSION -c conda-forge
source activate myenv
conda install -y numpy=$NUMPY_VERSION
python --version
python -c "import numpy; print(numpy.__version__)"
我認(rèn)為Miniconda3-4.7.10-Linux-x86_64.sh從 Internet 下載 Miniconda 安裝腳本后驗證校驗和是一種很好的做法。
您可以更改環(huán)境變量PYTHON_VERSION并NUMPY_VERSION獲取其他版本。
目前我們只是要驗證我們想要的 Python 和 NumPy 版本是否與python --version和一起使用，而不是“真正的”測試python -c "import numpy; print(numpy.__version__)"。對于上面的示例，您應(yīng)該在日志的末尾找到：
Python 3.5.5
1.14.2
根據(jù)您選擇的版本，您可能會收到錯誤消息：
如果您得到PackagesNotFoundError，則需要確保所選頻道具有您要查找的軟件包版本。（上例中選擇了Like conda-forge。）
如果您得到UnsatisfiableError，則您選擇了不兼容的軟件包版本。
以下是多個版本的示例配置：
version: 2
workflows:
version: 2
test:
jobs:
- python_3.5
- python_3.6
- python_3.7
template: &template
docker:
- image: ubuntu:bionic
steps:
- checkout
- run:
name: Setup Miniconda
command: |
apt update
apt install -y wget
cd $HOME
wget "https://repo.anaconda.com/miniconda/Miniconda3-4.7.10-Linux-x86_64.sh" -O miniconda.sh
printf '%s' "8a324adcc9eaf1c09e22a992bb6234d91a94146840ee6b11c114ecadafc68121 miniconda.sh" | sha256sum -c
bash miniconda.sh -b -p $HOME/miniconda
- run:
name: Setup environment and run tests
command: |
export PATH="$HOME/miniconda/bin:$PATH"
conda update -y conda
conda create -n myenv python=$PYTHON_VERSION
source activate myenv
conda install -y pip numpy=$NUMPY_VERSION
python --version
pip --version
python -c "import numpy; print(numpy.__version__)"
jobs:
python_3.5:
<<: *template
environment:
PYTHON_VERSION: 3.5
NUMPY_VERSION: 1.14.2
python_3.6:
<<: *template
environment:
PYTHON_VERSION: 3.6
NUMPY_VERSION: 1.15.2
python_3.7:
<<: *template
environment:
PYTHON_VERSION: 3.7
NUMPY_VERSION: 1.16.5
如果我將此最小示例應(yīng)用于您的案例，則配置將類似于以下內(nèi)容：
version: 2.0
workflows:
version: 2
test:
jobs:
- py3.6-np1.15
- py3.5-np1.15
- py3.6-np1.14
- py3.5-np1.14
- py3.7-np1.15
- py3.6-np1.16
- py3.7-np1.16
test-template: &test-template
docker:
- image: ubuntu:bionic
steps:
- checkout
- run:
name: Install System Dependencies
command: apt-get update && apt-get install -y libmpich12 libmpich-dev build-essential
# Download and cache dependencies
- restore_cache:
keys:
- v1-dependencies-{{ .Environment.CIRCLE_JOB }}-{{ checksum "setup.py" }}
- run:
name: install anaconda
command: |
apt update
apt install -y wget
cd $HOME
wget https://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh -O ~/miniconda.sh
chmod +x ~/miniconda.sh && bash ~/miniconda.sh -b -p $HOME/miniconda
export PATH=$HOME/miniconda/bin:$PATH
- run:
name: Install numpy, cython, mdtraj
command: |
export PATH="$HOME/miniconda/bin:$PATH"
conda update --yes conda
echo $PYTHON_VERSION
conda create -n myenv python=$PYTHON_VERSION -c conda-forge
source activate myenv
conda install --yes pip
conda install --yes -c conda-forge numpy=$NUMPY_VERSION cython=$CYTHON_VERSION
conda install --yes -c conda-forge nose mdtraj
python --version
python -c "import numpy; print(numpy.__version__)"
- run:
name: Install and build package
command: |
export PATH=$HOME/miniconda/bin:$PATH
source activate myenv
pip install --progress-bar off .[dev]
python setup.py build_ext --inplace
python setup.py install
- save_cache:
paths:
- ~/miniconda
key: v1-dependencies-{{ checksum "setup.py" }}
- run:
name: Run non-MPI tests
command: |
export PATH=$HOME/miniconda/bin:$PATH
source activate myenv
nosetests -a '!mpi' package
- run:
name: Run MPI tests
command: |
export PATH=$HOME/miniconda/bin:$PATH
source activate myenv
OMP_NUM_THREADS=1 mpiexec -n 2 nosetests -a mpi package
- store_artifacts:
path: test-reports
destination: test-reports
jobs:
py3.6-np1.15:
<<: *test-template
environment:
NUMPY_VERSION: 1.14.2
CYTHON_VERSION: 0.26.1
PYTHON_VERSION: 3.6
py3.5-np1.15:
<<: *test-template
environment:
NUMPY_VERSION: 1.14.2
CYTHON_VERSION: 0.26.1
PYTHON_VERSION: 3.5
py3.6-np1.14:
<<: *test-template
environment:
NUMPY_VERSION: 1.14.2
CYTHON_VERSION: 0.26.1
PYTHON_VERSION: 3.6
py3.5-np1.14:
<<: *test-template
environment:
NUMPY_VERSION: 1.14.2
CYTHON_VERSION: 0.26.1
PYTHON_VERSION: 3.5
py3.7-np1.15:
<<: *test-template
environment:
NUMPY_VERSION: 1.15.2
CYTHON_VERSION: 0.26.1
PYTHON_VERSION: 3.7.1
py3.6-np1.16:
<<: *test-template
environment:
NUMPY_VERSION: 1.16.5
CYTHON_VERSION: 0.26.1
PYTHON_VERSION: 3.6
py3.7-np1.16:
<<: *test-template
environment:
NUMPY_VERSION: 1.16.5
CYTHON_VERSION: 0.29.2
PYTHON_VERSION: 3.7.1
添加回答
舉報
0/150
提交
取消