Skip to main content

Python on Windows 10

Last weekend I wanted to clean up my python installation on Windows 10. In the past, I used a combination of Anaconda, Python app from the Windows Store, and Python distributions from python.org. Most of these were older versions that I have not updated in a while since I spend most of my time in WSL.

I started by deleting everything and cleaning up the installs. Afterwards, I downloaded python 3.8 from python.org, and proceeded with the installation. I selected install python for everyone and adding it to the %PATH% environment variable.

After the installation completed everything worked like a charm, until I started installing packages.

I started with installing TensorFlow:

pip install tensorflow

and got a cryptic error that one of the TensorFlow files was missing.

A quick internet search revealed that it is due to a missing setting for long filenames in Windows 10.  Following the instructions in this Stackoverflow post to enable long filenames option in the local computer policy, resolved the issue, and the installation proceeded smoothly.

Then I installed keras, and jupyterlab

pip install keras jupyterlab

and tried to run jupyter lab, which failed because Jupyter was not in the %PATH%.  Instead of adding another directory to the %PATH% variable, I ran jupyterlab through:

python -m jupyterlab

 

More keystrokes but works uniformly for any python module.

Now with python and the ML frameworks installed on Windows 10, I can make use of the GPU again. But not for long, since WSL is planning on adding GPU support soon, and there will be no need to live outside of WSL anymore.

Comments

Popular posts from this blog

Kindle Paperwhite

I have always been allergic to buying specialized electronic devices that do only one thing, such as the Kindle, the iPod, and fitness trackers. Why buy these when technology evolves so fast that a multi-purpose device such as the phone or a smart watch can eventually do the same thing, but with the convenience of updates that fix bugs and add functionality? So, I was shocked when this weekend I made an impulse buy and got the newest Kindle Paperwhite—a special purpose device for reading eBooks. I was walking past the Amazon store in the mall and saw that the newest Kindle Paperwhites were marked down by $40 for the holidays. The device looked good in the display, so I went in to look at it closely. The Paperwhite is small and light, with a 6” screen that is backlit and waterproof.   The text was crisp and readable, and in the ambient light, it felt like I am reading a printed book. I was sold and bought it on the spot. At home I have struggled to put it down. The bo...

MacOS Catalina, OneDrive, and case sensitive file systems

Over the weekend, I dusted off my old Macbook Air to search for some old family photos. I have not used the laptop for a long time, and it was completely out of charge. I plugged it in, and it quickly booted. Shortly after, I got bombarded with notifications that many of the applications needed updating, and that a new version of the OS was available.   I waited till I found the photos I was looking for, before attempting to upgrade anything. I also wanted to install OneDrive to get my old files to the cloud, so that I can access them from any of my devices, instead of dusting off old computers to get to them. The MacOS upgrade experience has always been fantastic, and this one was no different. The OS upgrade files downloaded quickly and after a restart and a quick install, the Macbook Air was ready to go.   Upgrading the installed applications was also a breeze, however in the process I discovered that a large majority of the applications installed were not compatible ...

Mining the Social Web, by Mathew Russell, O'Reilly Media

"Mining the social web" is a book about how to access social data from the most popular social services today by using the services' public APIs, and analyzing the retrieved data to gain insights about it. The book uses the Python programming language to access and manipulate the data, and provides code snippets of common tasks within the book, as well as full iPython notebooks on Github. The book is written as documentation for the freely available iPython notebooks, with the documentation providing context and background for the code, as well as describing the algorithms used to mine the social data. The author tries to be as concise as possible, although he did not succeed in the first chapter, where the first three section were verbose, and relatively unnecessary,  describing what twitter is and why people use it as a microblogging platform. With that out of the way, the writing style improves as the book progresses, and is a mixture of code examples and step ...