Recommended
More Related Content
What's hot
What's hot (20)
Similar to Deep Learning at Instacart
Similar to Deep Learning at Instacart (18)
Recently uploaded
Recently uploaded (20)
Deep Learning at Instacart
- 1. Deep Learning at Instacart
- 2. v @jeremystan Agenda https://tech.instacart.com/deep-learning-with-emojis-not-math-660ba1ad6cdc The FutureNow Ice Cream http://sharkplane77.deviantart.com/art/the-flying-carrot-282230078
- 3. v @jeremystan Our Value Proposition Groceries from stores you love delivered to your doorstep in as little as an hour + + + =
- 6. v @jeremystan List Sorting 100s of retailers 1,000s of stores 10,000s of shoppers 1,000,000s of products
- 7. v @jeremystan Why Not? Can’t we just? ...build warehouses? No ...get store data? Often not …map manually? Infrequently ...map with tech? Not yet
- 8. v @jeremystan Results 618 years of shopping 125 million US households 5% market share 1x trips / week 1 minute saved per trip Shopper Speed (Items per Minute) Batch Size (Items Picked)
- 9. v @jeremystan Problem Definition 1 2 3 4 5 6 7 8 9 10 Learn sequence Predict sequence
- 10. v @jeremystan Problem Definition Last CandidatesNext Pr next= last= ,candidates=
- 11. v @jeremystan Initial Architecture 1 Cross Entropy 1 DeterministicLearned 1m 10m Final Layer 1m Masked Soft Max Hidden Layers 700k 30 10 Embedding 10m 1m 10 tensor length # parameters Predicted 1m = 32% Pr next= last= ,candidates= Embedding 10k 1k 10 10 Embedding 100k 10k
- 12. v @jeremystan 51 Lines of Keras
- 13. v @jeremystan 1 10 1m Initial Architecture Embedding Embedding Embedding Hidden Layers Predicted 10m 10k 100k 700k 10m Final Layer 1m 1k 10k 10 10 30 10 1m Cross Entropy 1 DeterministicLearned Masked Soft Max 1m tensor length # parameters = 32% Pr next= last= ,candidates=
- 14. v @jeremystan Discovering Layout 10 Embedding Embedding Embedding 10m 10k 100k 1m 1k 10k 10 10 30
- 15. v @jeremystan Discovering Layout 10 Embedding Embedding Embedding 10m 10k 100k 1m 1k 10k 10 10 30
- 16. v @jeremystan 1 10 1m Initial Architecture Weaknesses Embedding Embedding Embedding Hidden Layers Predicted 10m 10k 100k 700k 10m Final Layer 1m 1k 10k 10 10 30 10 1m Cross Entropy 1Masked Soft Max 1m Redundant No metadata Dense
- 17. v @jeremystan 1 10 1m Final Architecture Embedding Embedding Embedding Hidden Layers Predicted 10m 10k 100k 700k 10m Final Layer 1m 1k 10k 10 10 30 10 1m Cross Entropy 1Masked Soft Max 1m
- 19. v @jeremystan 1 10m 10 Final Architecture Shared Embedding Embedding Embedding 10k 100k 700k 1m 1k 10k 10 10 40 1m 10Shared Embedding Hidden Layers Score = 0.7
- 20. v @jeremystan 1 10m 10 Final Architecture Shared Embedding Embedding Embedding 10k 100k 700k 1m 1k 10k 10 10 40 1m 10Shared Embedding Hidden Layers Score = 0.7
- 21. v @jeremystan 1 10m 10 Final Architecture Shared Embedding Embedding Embedding 10k 100k 700k 1m 1k 10k 10 10 40 1m 10Shared Embedding Hidden Layers Score = 0.7 10.81m Score Generator
- 22. v @jeremystan Final Architecture Score 1 10m 10 Shared Embedding Embedding Embedding 10k 100k 700k 1m 1k 10k 10 10 40 1m 10Shared Embedding Hidden Layers = 0.7 10.81m Score Generator
- 23. v @jeremystan Final Architecture Score 10.81m Score Generator 1m 1 10.81m Score Generator Score 0.7
- 25. v @jeremystan 1m Final Architecture 1Score Generator Score 10.81m 1m 1Score Generator Score 0.7 -0.2
- 26. v @jeremystan 1m Final Architecture 1Score Generator Score 1m 1Score Generator Score 0.7 -0.2 1m 1Score Generator Score 1m 1Score Generator Score 1m 1Score Generator Score 10.81m -0.4 1.3 1.1
- 27. v @jeremystan 1m Final Architecture 1Score Generator Score 1m 1Score Generator Score 1m 1Score Generator Score 1m 1Score Generator Score 1m 1Score Generator Score 1 Predicted Cross Entropy 1Soft Max 5 = 36% 10.81m 10x faster training 10% better accuracy 2x slower prediction
- 28. v @jeremystan Team Francisco Guzman Designer Nima Zahedi Product Manager Montana Low Machine Learning Engineer
- 29. v @jeremystan Agenda https://tech.instacart.com/deep-learning-with-emojis-not-math-660ba1ad6cdc The FutureNow Ice Cream http://sharkplane77.deviantart.com/art/the-flying-carrot-282230078
- 32. v @jeremystan Product Recognition on Aisles
- 34. v @jeremystan Agenda https://tech.instacart.com/deep-learning-with-emojis-not-math-660ba1ad6cdc The FutureNow Ice Cream http://sharkplane77.deviantart.com/art/the-flying-carrot-282230078
- 35. v @jeremystan orders (3.4m rows, 206k users) order_products (30m rows) products (50k rows) https://tech.instacart.com/3-million-instacart-orders-open-sourced-d40d29ead6f2
- 36. v @jeremystan Applications Sort “Buy It Again” Recommend Items
- 37. v @jeremystan The Food We Eat Half And Half Ultra Pasteurized Sweet & Salty Nut Granola Bars Peanut Pub Mix Nutri Grain Bars Multi Pack Trail Mix Original Rice Krispies Treats Apples Cheez-It Baked Snack Crackers Dry Roasted Almonds Zero Calorie Cola Crunchy Oats 'n Honey Granola Bars Original Beef Jerky Cheez-It Cheddar Cracker Popcorn Milk Chocolate Almonds 0% Greek Strained Yogurt Extra Fancy Unsalted Mixed Nuts Pink Lady Apples with Crispy Almonds Cereal Original Almondmilk Clementines Half And Half Cream French Vanilla Coffee Creamer Orange & Lemon Flavor Sparkling Fruit Beverage Cinnamon Brown Sugar Breakfast Biscuits Half Baked Frozen Yogurt The Tonight Dough™ Ice Cream Americone Dream® Ice Cream Half Baked® Ice Cream Phish Food® Ice Cream Milk and Cookies Ice Cream Sicilian Pistachio Chocolate Peanut Butter Cup Gelato Birthday Cake Light Ice Cream Cherry Garcia Ice Cream Strawberry Ice Cream Vanilla Bean Light Ice Cream Coffee Ice Cream Roman Raspberry Sorbetto Mediterranean Mint Gelato Caramel Cookie Crunch Gelato Chocolate Chip Cookie Dough Ice Cream Mint Chip Coconut Almond Minis Frozen Dessert Bars Mint Chocolate Chip Ice Cream Chocolate Peanut Butter Ice Cream Vanilla Milk Chocolate Almond Ice Cream Bars Sea Salt Caramel Gelato Vanilla Bean Ice Cream Rising Crust Pepperoni Pizza
- 38. v @jeremystan The Food We Eat Half Baked Frozen Yogurt The Tonight Dough™ Ice Cream Americone Dream® Ice Cream Half Baked® Ice Cream Phish Food® Ice Cream Milk and Cookies Ice Cream Sicilian Pistachio Chocolate Peanut Butter Cup Gelato Birthday Cake Light Ice Cream Cherry Garcia Ice Cream Strawberry Ice Cream Vanilla Bean Light Ice Cream Coffee Ice Cream Roman Raspberry Sorbetto Mediterranean Mint Gelato Caramel Cookie Crunch Gelato Chocolate Chip Cookie Dough Ice Cream Mint Chip Coconut Almond Minis Frozen Dessert Bars Mint Chocolate Chip Ice Cream Chocolate Peanut Butter Ice Cream Vanilla Milk Chocolate Almond Ice Cream Bars Sea Salt Caramel Gelato Vanilla Bean Ice Cream Rising Crust Pepperoni Pizza #1 #2
- 39. WE’RE HIRING! @jeremystan | e-mail: jeremy.stanley@instacart.com careers: careers.instacart.com