SlideShare a Scribd company logo
1 of 74
Download to read offline
Pipenv!
Python Dev Workflow
for Humans
Andreu Vallbona
PyDay Mallorca - September 2019
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Who am I
Andreu Vallbona @avallbona
Bachelor degree in computer science
Web developer at APSL, Mallorca, Spain
Mainly developing with Python and Django
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
What we do at APSL
Web development
Systems engineering - devops
Data science
Mobile apps
Consulting and formation
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
What it is?
it’s a package and virtualenv
managing system
it’s aimed to replace
the use of pip and virtualenv
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Created by
Kenneth Reitz
Creator of many
useful projects such as:
Requests: HTTP for Humans
Maya: Datetimes for Humans
Records: SQL for Humans
Requests-HTML: HTML Parsing for Humans
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Current state of the art
Before pipenv we used to
create a python environment
with virtualenv
install some packages
freeze the dependencies
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
requirements.txt anatomy
list of dependencies
with pinned versions
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Problems
Problems
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Problems
pip and virtualenv are concepts
difficult to understand for beginners
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Problems
requirements.txt
is difficult to maintain
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Problems
we have to remember
to update the requirements.txt file
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Problems
For different environments
we need to maintain
several requirements.txt files
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Problems
we do not easily know
what python version
the project uses
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Problems
transitive relations
A -> B -> C
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Solutions
Solutions
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
What problems does pipenv solve?
avoid manually maintenance
of the dependencies
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
What problems does pipenv solve?
easy to know which
version of python
the project uses
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
What problems does pipenv solve?
show us the dependencies
in a more concise way
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
What problems does pipenv solve?
update dependencies
securely and automatically
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
What problems does pipenv solve?
allow us to have a
default environment
and a development environment
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Installation
Installation
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Installation
pip install --user pipenv
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Pipfile anatomy
Specify the packages we want
Production and development
sections
Human readable
Toml format
Specify the python version
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Pipfile.lock anatomy
Specify the packages we need
Json format
Machine readable
Easy to parse
Pinned versions
Hashes
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Pipfile.lock anatomy
Specify the packages we need
Json format
Machine readable
Easy to parse
Pinned versions
Hashes
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv install
creates the virtualenv
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv shell
activates the virtualenv
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv install <package-name>
install a package
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv install <package-name> --dev
install a package
in the development environment
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv uninstall <package-name>
uninstall a package
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv clean
uninstall packages
not specified in Pipfile.lock
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv graph
Displays currently installed
dependency graph information
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv run command
runs a command inside
the virtualenv without activating it
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv check
checks for security vulnerabilities
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv lock -r > requirements.txt
generates a requirements.txt file
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
pipenv install -r requirements.txt
imports a requirements.txt file
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
load .env files automatically
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
usage
pipenv install -c .
can discover requirements
from the codebase
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
usage
pipenv check --unused .
show potentially
unused dependencies
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
usage
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Integration
Integration
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Integration with pyenv
pipenv --python 3.4.1 install
integrates well with pyenv
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Integration with pyenv
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Integration with docker
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Integration with platforms and editors
integrated with
platforms and editors
Heroku (Cloud Hosting)
Platform.sh (Cloud Hosting)
PyUp (Security Notification)
Emacs (Editor Integration)
Fish Shell
(Automatic $ pipenv shell!)
VS Code (Editor Integration)
PyCharm (Editor Integration)
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
utility
Utility
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
utility
Pipenv Pipes
https://github.com/gtalarico/pipenv-pipes
Pipenv Environment Switcher
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
utility
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
caveats
Caveats
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
caveats
It’s slow when locking dependencies
Always tries to update
dependencies by default
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
caveats
The default It’s
update packages
always to lastest
versions
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
caveats
But it can be solved !!!
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Caveats
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
Caveats
Or directly pinning
all the versions into
the Pipfile
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
alternatives
Alternatives
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
alternatives
Poetry
https://poetry.eustace.io/
Hatch
https://github.com/ofek/hatch
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
thanks
Thank you!
Questions?
@avallbona
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
resources of interest
https://www.pythonforbeginners.com/basics/how-to-use-pip-and-pypi
https://realpython.com/pipenv-guide/
https://www.kennethreitz.org/essays/announcing-pipenv
https://nvie.com/posts/better-package-management/
https://nvie.com/posts/pin-your-packages/
https://medium.com/@jimjh/managing-dependencies-in-python-applications-b9c93dda98c2
Pipenv: Python Dev Workflow for Humans
Andreu Vallbona - PyDay Mallorca - September 2019
resources of interest
https://www.promptworks.com/blog/pin-all-dependencies
https://www.well-typed.com/blog/2008/04/the-dreaded-diamond-dependency-problem/
https://medium.com/@DJetelina/pipenv-review-after-using-in-production-a05e7176f3f0
https://chriswarrick.com/blog/2018/07/17/pipenv-promises-a-lot-delivers-very-little/
https://np.reddit.com/r/Python/comments/8jd6aq/why_is_pipenv_the_recommended_packaging_tool_by/
http://journal.kennethreitz.org/entry/r-python

More Related Content

Similar to Py Day Mallorca - Pipenv - Python Dev Workflow for Humans

Scientist meets web dev: how Python became the language of data
Scientist meets web dev: how Python became the language of dataScientist meets web dev: how Python became the language of data
Scientist meets web dev: how Python became the language of dataGael Varoquaux
 
Why Python is the Best Coding Language For PWA Development_.ppt
Why Python is the Best Coding Language For PWA Development_.pptWhy Python is the Best Coding Language For PWA Development_.ppt
Why Python is the Best Coding Language For PWA Development_.pptTechinventive Software
 
Build a RESTful API with the Serverless Framework
Build a RESTful API with the Serverless FrameworkBuild a RESTful API with the Serverless Framework
Build a RESTful API with the Serverless Frameworkmasahitojp
 
Building Serverless applications with Python
Building Serverless applications with PythonBuilding Serverless applications with Python
Building Serverless applications with PythonAndrii Soldatenko
 
Cloud Foundry for Data Science
Cloud Foundry for Data ScienceCloud Foundry for Data Science
Cloud Foundry for Data ScienceIan Huston
 
APIs for your Business + Stages of the API Lifecycle
APIs for your Business + Stages of the API LifecycleAPIs for your Business + Stages of the API Lifecycle
APIs for your Business + Stages of the API Lifecycle3scale
 
Deck 8983a1d9-68df-4447-8481-3b4fd0de734c-9-52-74
Deck 8983a1d9-68df-4447-8481-3b4fd0de734c-9-52-74Deck 8983a1d9-68df-4447-8481-3b4fd0de734c-9-52-74
Deck 8983a1d9-68df-4447-8481-3b4fd0de734c-9-52-74Ivy Rueb
 
Intro To JavaScript
Intro To JavaScriptIntro To JavaScript
Intro To JavaScriptIvy Rueb
 
The story of migrating from Java to Python
The story of migrating from Java to PythonThe story of migrating from Java to Python
The story of migrating from Java to Pythonivohoubrechts1
 
Postman covid-webinar
Postman covid-webinarPostman covid-webinar
Postman covid-webinarPostman
 
Operational research 4 dec 2019 tutorialsduniya
Operational research  4 dec 2019   tutorialsduniyaOperational research  4 dec 2019   tutorialsduniya
Operational research 4 dec 2019 tutorialsduniyaTutorialsDuniya.com
 
Why Python Should Be Your First Programming Language
Why Python Should Be Your First Programming LanguageWhy Python Should Be Your First Programming Language
Why Python Should Be Your First Programming LanguageEdureka!
 
How to Choose a Programming Language
How to Choose a Programming LanguageHow to Choose a Programming Language
How to Choose a Programming LanguageThinkful
 
Python certification
Python certificationPython certification
Python certificationHimanshuPise2
 
Comparison between python and c++
Comparison between python and c++Comparison between python and c++
Comparison between python and c++ssusera7faf41
 
Building APIs with the OpenApi Spec
Building APIs with the OpenApi SpecBuilding APIs with the OpenApi Spec
Building APIs with the OpenApi SpecPedro J. Molina
 

Similar to Py Day Mallorca - Pipenv - Python Dev Workflow for Humans (20)

Scientist meets web dev: how Python became the language of data
Scientist meets web dev: how Python became the language of dataScientist meets web dev: how Python became the language of data
Scientist meets web dev: how Python became the language of data
 
Why Python is the Best Coding Language For PWA Development_.ppt
Why Python is the Best Coding Language For PWA Development_.pptWhy Python is the Best Coding Language For PWA Development_.ppt
Why Python is the Best Coding Language For PWA Development_.ppt
 
Build a RESTful API with the Serverless Framework
Build a RESTful API with the Serverless FrameworkBuild a RESTful API with the Serverless Framework
Build a RESTful API with the Serverless Framework
 
Goncalo Pereira - CV
Goncalo Pereira - CVGoncalo Pereira - CV
Goncalo Pereira - CV
 
Building Serverless applications with Python
Building Serverless applications with PythonBuilding Serverless applications with Python
Building Serverless applications with Python
 
Cloud Foundry for Data Science
Cloud Foundry for Data ScienceCloud Foundry for Data Science
Cloud Foundry for Data Science
 
APIs for your Business + Stages of the API Lifecycle
APIs for your Business + Stages of the API LifecycleAPIs for your Business + Stages of the API Lifecycle
APIs for your Business + Stages of the API Lifecycle
 
Deck 8983a1d9-68df-4447-8481-3b4fd0de734c-9-52-74
Deck 8983a1d9-68df-4447-8481-3b4fd0de734c-9-52-74Deck 8983a1d9-68df-4447-8481-3b4fd0de734c-9-52-74
Deck 8983a1d9-68df-4447-8481-3b4fd0de734c-9-52-74
 
Intro To JavaScript
Intro To JavaScriptIntro To JavaScript
Intro To JavaScript
 
Python in a real life
Python in a real lifePython in a real life
Python in a real life
 
The story of migrating from Java to Python
The story of migrating from Java to PythonThe story of migrating from Java to Python
The story of migrating from Java to Python
 
Introduction To Python
Introduction To PythonIntroduction To Python
Introduction To Python
 
Postman covid-webinar
Postman covid-webinarPostman covid-webinar
Postman covid-webinar
 
Operational research 4 dec 2019 tutorialsduniya
Operational research  4 dec 2019   tutorialsduniyaOperational research  4 dec 2019   tutorialsduniya
Operational research 4 dec 2019 tutorialsduniya
 
Why Python Should Be Your First Programming Language
Why Python Should Be Your First Programming LanguageWhy Python Should Be Your First Programming Language
Why Python Should Be Your First Programming Language
 
How to Choose a Programming Language
How to Choose a Programming LanguageHow to Choose a Programming Language
How to Choose a Programming Language
 
Python certification
Python certificationPython certification
Python certification
 
Comparison between python and c++
Comparison between python and c++Comparison between python and c++
Comparison between python and c++
 
Building APIs with the OpenApi Spec
Building APIs with the OpenApi SpecBuilding APIs with the OpenApi Spec
Building APIs with the OpenApi Spec
 
Pyhton-1a-Basics.pdf
Pyhton-1a-Basics.pdfPyhton-1a-Basics.pdf
Pyhton-1a-Basics.pdf
 

Recently uploaded

Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 

Recently uploaded (20)

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 

Py Day Mallorca - Pipenv - Python Dev Workflow for Humans

  • 1. Pipenv! Python Dev Workflow for Humans Andreu Vallbona PyDay Mallorca - September 2019
  • 2. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Who am I Andreu Vallbona @avallbona Bachelor degree in computer science Web developer at APSL, Mallorca, Spain Mainly developing with Python and Django
  • 3. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 What we do at APSL Web development Systems engineering - devops Data science Mobile apps Consulting and formation
  • 4. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 What it is? it’s a package and virtualenv managing system it’s aimed to replace the use of pip and virtualenv
  • 5. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Created by Kenneth Reitz Creator of many useful projects such as: Requests: HTTP for Humans Maya: Datetimes for Humans Records: SQL for Humans Requests-HTML: HTML Parsing for Humans
  • 6. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Current state of the art Before pipenv we used to create a python environment with virtualenv install some packages freeze the dependencies
  • 7. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 requirements.txt anatomy list of dependencies with pinned versions
  • 8. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Problems Problems
  • 9. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Problems pip and virtualenv are concepts difficult to understand for beginners
  • 10. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Problems requirements.txt is difficult to maintain
  • 11. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Problems we have to remember to update the requirements.txt file
  • 12. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Problems For different environments we need to maintain several requirements.txt files
  • 13. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Problems we do not easily know what python version the project uses
  • 14. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Problems transitive relations A -> B -> C
  • 15. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Solutions Solutions
  • 16. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 What problems does pipenv solve? avoid manually maintenance of the dependencies
  • 17. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 What problems does pipenv solve? easy to know which version of python the project uses
  • 18. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 What problems does pipenv solve? show us the dependencies in a more concise way
  • 19. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 What problems does pipenv solve? update dependencies securely and automatically
  • 20. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 What problems does pipenv solve? allow us to have a default environment and a development environment
  • 21. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Installation Installation
  • 22. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Installation pip install --user pipenv
  • 23. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Pipfile anatomy Specify the packages we want Production and development sections Human readable Toml format Specify the python version
  • 24. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Pipfile.lock anatomy Specify the packages we need Json format Machine readable Easy to parse Pinned versions Hashes
  • 25. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Pipfile.lock anatomy Specify the packages we need Json format Machine readable Easy to parse Pinned versions Hashes
  • 26. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage Usage
  • 27. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv install creates the virtualenv
  • 28. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 29. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv shell activates the virtualenv
  • 30. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 31. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv install <package-name> install a package
  • 32. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 33. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv install <package-name> --dev install a package in the development environment
  • 34. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 35. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv uninstall <package-name> uninstall a package
  • 36. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 37. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv clean uninstall packages not specified in Pipfile.lock
  • 38. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 39. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv graph Displays currently installed dependency graph information
  • 40. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 41. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv run command runs a command inside the virtualenv without activating it
  • 42. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 43. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv check checks for security vulnerabilities
  • 44. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 45. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv lock -r > requirements.txt generates a requirements.txt file
  • 46. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 47. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage pipenv install -r requirements.txt imports a requirements.txt file
  • 48. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 49. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 50. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage load .env files automatically
  • 51. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Usage
  • 52. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 usage pipenv install -c . can discover requirements from the codebase
  • 53. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 usage
  • 54. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 usage pipenv check --unused . show potentially unused dependencies
  • 55. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 usage
  • 56. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Integration Integration
  • 57. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Integration with pyenv pipenv --python 3.4.1 install integrates well with pyenv
  • 58. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Integration with pyenv
  • 59. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Integration with docker
  • 60. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Integration with platforms and editors integrated with platforms and editors Heroku (Cloud Hosting) Platform.sh (Cloud Hosting) PyUp (Security Notification) Emacs (Editor Integration) Fish Shell (Automatic $ pipenv shell!) VS Code (Editor Integration) PyCharm (Editor Integration)
  • 61. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 utility Utility
  • 62. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 utility Pipenv Pipes https://github.com/gtalarico/pipenv-pipes Pipenv Environment Switcher
  • 63. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 utility
  • 64. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 caveats Caveats
  • 65. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 caveats It’s slow when locking dependencies Always tries to update dependencies by default
  • 66. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 caveats The default It’s update packages always to lastest versions
  • 67. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 caveats But it can be solved !!!
  • 68. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Caveats
  • 69. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 Caveats Or directly pinning all the versions into the Pipfile
  • 70. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 alternatives Alternatives
  • 71. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 alternatives Poetry https://poetry.eustace.io/ Hatch https://github.com/ofek/hatch
  • 72. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 thanks Thank you! Questions? @avallbona
  • 73. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 resources of interest https://www.pythonforbeginners.com/basics/how-to-use-pip-and-pypi https://realpython.com/pipenv-guide/ https://www.kennethreitz.org/essays/announcing-pipenv https://nvie.com/posts/better-package-management/ https://nvie.com/posts/pin-your-packages/ https://medium.com/@jimjh/managing-dependencies-in-python-applications-b9c93dda98c2
  • 74. Pipenv: Python Dev Workflow for Humans Andreu Vallbona - PyDay Mallorca - September 2019 resources of interest https://www.promptworks.com/blog/pin-all-dependencies https://www.well-typed.com/blog/2008/04/the-dreaded-diamond-dependency-problem/ https://medium.com/@DJetelina/pipenv-review-after-using-in-production-a05e7176f3f0 https://chriswarrick.com/blog/2018/07/17/pipenv-promises-a-lot-delivers-very-little/ https://np.reddit.com/r/Python/comments/8jd6aq/why_is_pipenv_the_recommended_packaging_tool_by/ http://journal.kennethreitz.org/entry/r-python