I recently switched to the Anaconda Python distribution and I'm trying to get the hang of things. I wanted to install this yaml-related package and since there isn't already a conda recipe for it, I tried
conda pipbuild layered-yaml-attrdict-config
which resulted in the following output (I removed non-relevant entries of my system path):
C:\Anaconda>conda install layered-yaml-attrdict-config
Fetching package metadata: ..
Error: No packages found matching: layered-yaml-attrdict-config
C:\Anaconda>conda pipbuild layered-yaml-attrdict-config
Fetching package metadata: ..
Creating standard recipe for layered-yaml-attrdict-config-14.06.7
Using url https://pypi.python.org/packages/source/l/layered-yaml-attrdict-config
/layered-yaml-attrdict-config-14.06.7.tar.gz (6147) for layered-yaml-attrdict-co
nfig.
Downloading layered-yaml-attrdict-config (use --no-download to skip this step)
Unpacking layered-yaml-attrdict-config...
done
working in c:\users\bnables\appdata\local\temp\1\tmp07kkdbconda_skeleton_layered
-yaml-attrdict-config
Fetching package metadata: ...
Solving package specifications: .
The following packages will be downloaded:
package | build
---------------------------|-----------------
python-2.7.7 | 2 17.1 MB
The following packages will be linked:
package | build
---------------------------|-----------------
python-2.7.7 | 2 hard-link
pyyaml-3.11 | py27_0 hard-link
setuptools-3.6 | py27_0 hard-link
Fetching packages ...
python-2.7.7-2 100% |###############################| Time: 0:00:08 2.00 MB/s
Extracting packages ...
[ COMPLETE ] |#################################################| 100%
Linking packages ...
[ COMPLETE ] |#################################################| 100%
Applying patch: u'c:\\users\\bnables\\appdata\\local\\temp\\1\\tmp07kkdbconda_sk
eleton_layered-yaml-attrdict-config\\pypi-distutils.patch'
Error:
Did not find 'patch' in: C:\Anaconda\envs\_build\Scripts;C:\Anaconda\Scripts
;C:\Anaconda;C:\Anaconda\Scripts
You can install 'patch' using apt-get, yum (Linux), Xcode (MacOSX),
or conda, cygwin (Windows),
conda create -n _pipbuild_ --yes python pip
Fetching package metadata: ..
Solving package specifications: .
Package plan for installation in environment C:\Anaconda\envs\_pipbuild_:
The following packages will be linked:
package | build
---------------------------|-----------------
pip-1.5.6 | py27_0 hard-link
python-2.7.7 | 2 hard-link
setuptools-3.6 | py27_0 hard-link
WARNING: the process C:\Anaconda\python.exe C:\Anaconda\Scripts\conda-script.py
pipbuild layered-yaml-attrdict-config (7712) is running
WARNING: the process C:\Anaconda\Scripts\conda-pipbuild.exe layered-yaml-attrdic
t-config (4596) is running
WARNING: the process C:\Anaconda\python.exe C:\Anaconda\Scripts\conda-pipbuild-s
cript.py layered-yaml-attrdict-config (7208) is running
WARNING: Continuing installation while the above processes are running is
not recommended. Please, close all Anaconda programs before installing or
updating things with conda.
Extracting packages ...
[ COMPLETE ] |#################################################| 100%
Linking packages ...
[ COMPLETE ] |#################################################| 100%
#
# To activate this environment, use:
# > activate _pipbuild_
#
C:\Anaconda\envs\_pipbuild_/bin/pip install layered-yaml-attrdict-config==14.06.
7
Traceback (most recent call last):
File "C:\Anaconda\Scripts\conda-pipbuild-script.py", line 4, in <module>
sys.exit(main())
File "C:\Anaconda\lib\site-packages\conda_build\main_pipbuild.py", line 76, in
main
args.func(args, p)
File "C:\Anaconda\lib\site-packages\conda_build\main_pipbuild.py", line 347, i
n execute
build_package(package, version)
File "C:\Anaconda\lib\site-packages\conda_build\main_pipbuild.py", line 300, i
n build_package
directory, dependencies = make_recipe(package, version)
File "C:\Anaconda\lib\site-packages\conda_build\main_pipbuild.py", line 244, i
n make_recipe
depends = get_all_dependencies(package, version)
File "C:\Anaconda\lib\site-packages\conda_build\main_pipbuild.py", line 214, i
n get_all_dependencies
ret = subprocess.Popen(cmd2.split()).wait()
File "C:\Anaconda\lib\subprocess.py", line 710, in __init__
errread, errwrite)
File "C:\Anaconda\lib\subprocess.py", line 958, in _execute_child
startupinfo)
WindowsError: [Error 2] The system cannot find the file specified
C:\Anaconda>
I'm not sure what happened since I don't know what file it was looking for and I don't yet know anything about conda recipes except they're supposed to be awesome and not give these kinda of errors.
I was hoping to install through conda so that everything could be managed by conda instead of some stuff being managed by pip.
Digging into the main_pipbuild.py
source it looks like it's trying to run C:\Anaconda\envs\_pipbuild_\bin\pip install package==version
(with the appropriate package and version). When I look at my C:\Anaconda\envs_pipbuild_ there is no bin folder, so I'm guessing pip didn't get installed into the pipbuild environment correctly. The previous warnings about not having "patch" may also be a problem...
After installing patch
with conda install patch
I tried again with the following results:
C:\Anaconda>conda pipbuild layered-yaml-attrdict-config
Fetching package metadata: ..
Creating standard recipe for layered-yaml-attrdict-config-14.06.7
Using url https://pypi.python.org/packages/source/l/layered-yaml-attrdict-config/layered-yaml-attrdict-config-14.06.7.ta
r.gz (6147) for layered-yaml-attrdict-config.
Downloading layered-yaml-attrdict-config (use --no-download to skip this step)
Unpacking layered-yaml-attrdict-config...
done
working in c:\users\bnables\appdata\local\temp\1\tmp7cuibgconda_skeleton_layered-yaml-attrdict-config
Fetching package metadata: ...
Solving package specifications: .69 unparsed bytes left at the end of stream
file 1/1: core.py
hunk no.1 doesn't match source file at line 165
expected:
actual : raise SystemExit, "error: " + str(msg)
source file is different - core.py
Applying patch: u'c:\\users\\bnables\\appdata\\local\\temp\\1\\tmp7cuibgconda_skeleton_layered-yaml-attrdict-config\\pyp
i-distutils.patch'
Traceback (most recent call last):
File "C:\Anaconda\Scripts\conda-skeleton-script.py", line 4, in <module>
sys.exit(main())
File "C:\Anaconda\lib\site-packages\conda_build\main_skeleton.py", line 124, in main
args.func(args, p)
File "C:\Anaconda\lib\site-packages\conda_build\main_skeleton.py", line 135, in execute
pypi.main(args, parser)
File "C:\Anaconda\lib\site-packages\conda_build\pypi.py", line 314, in main
run_setuppy(src_dir, tempdir, args)
File "C:\Anaconda\lib\site-packages\conda_build\pypi.py", line 485, in run_setuppy
apply_patch(join(stdlib_dir, 'distutils'), patch)
File "C:\Anaconda\lib\site-packages\conda_build\source.py", line 202, in apply_patch
check_call([patch, '-p0', '-i', path], cwd=src_dir)
File "C:\Anaconda\lib\subprocess.py", line 540, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '[u'C:\\Anaconda\\Scripts\\patch.bat', u'-p0', u'-i', u'c:\\users\\bnables\\appda
ta\\local\\temp\\1\\tmp7cuibgconda_skeleton_layered-yaml-attrdict-config\\pypi-distutils.patch']' returned non-zero exit
status -1
conda create -n _pipbuild_ --yes python pip
Error: prefix already exists: C:\Anaconda\envs\_pipbuild_
C:\Anaconda\envs\_pipbuild_/bin/pip install layered-yaml-attrdict-config==14.06.7
Traceback (most recent call last):
File "C:\Anaconda\Scripts\conda-pipbuild-script.py", line 4, in <module>
sys.exit(main())
File "C:\Anaconda\lib\site-packages\conda_build\main_pipbuild.py", line 76, in main
args.func(args, p)
File "C:\Anaconda\lib\site-packages\conda_build\main_pipbuild.py", line 347, in execute
build_package(package, version)
File "C:\Anaconda\lib\site-packages\conda_build\main_pipbuild.py", line 300, in build_package
directory, dependencies = make_recipe(package, version)
File "C:\Anaconda\lib\site-packages\conda_build\main_pipbuild.py", line 244, in make_recipe
depends = get_all_dependencies(package, version)
File "C:\Anaconda\lib\site-packages\conda_build\main_pipbuild.py", line 214, in get_all_dependencies
ret = subprocess.Popen(cmd2.split()).wait()
File "C:\Anaconda\lib\subprocess.py", line 710, in __init__
errread, errwrite)
File "C:\Anaconda\lib\subprocess.py", line 958, in _execute_child
startupinfo)
WindowsError: [Error 2] The system cannot find the file specified
So it finds some kind of problem with the package perhaps at Solving package specifications: .69 unparsed bytes left at the end of stream
. Then it does this patch thing which apparently fails. Then it tries to do pip install
and again can't find the bin/pip directory in the pipbuild environment.
Should it be looking for pip at C:\Anaconda\envs\_pipbuild_\Scripts\pip.exe
? Because that does exist.
If this is a bug, here's where to report it: https://github.com/conda/conda-build/issues. I'll wait for feedback before doing any more.
Any help would be great!