Drafts

These are my notes from pycon 2018 videos. I love the python community and especially the conference talks. This year I am going to take some notes from my favorite talks and post them here. This is an Incomplete working post. Jake VanderPlas - Performance Python: Seven Strategies for Optimizing Your Numerical Code [1] # [2] - Always profile before making any optimizations. - Vectorize with Numpy - Looping in python can be slow - Use specialized data structures. - scipy.spacial - pandas - xarray - scipy.sparse - sparse package - scipy.sparce.csgraph - Cython - Add types - Numba - jit - Fortran Like Speed - heavy dependencies - Dask - distributed tasks - Can be executed locally or on a cluster - Look for an existing package - resist the urge to reinvent the wheel https://www.youtube.com/watch?v=zQeYx87mfyw Justin Crown - “WHAT IS THIS MESS?” - Writing tests for pre-existing code bases - PyCon 2018 [3] # [4] This was a great talk about not only test driven de...

In 2018 I transitioned from a Product Engineering (Mechanical) role to a Data Scientist Role. I entered this space with strong subject matter expertise with our products, our data, munging through data in pyhon, and data visualization in python. My sql skills were lacking to say the least. I had learned what I needed to know to get data from our relational databases, then use pandas to do any further analysis. Just run something like the following and you have data. SELECT * FROM Table Where col_1 = 'col_1_filter' This technique works great for small data sets that you only need to run once. There is no shame to pull in a big dataset and start munging with it in pandas to get some results, and make decisions. The problem becomes when your dataset becomes too big or you need to run the query on a frequent basis. Doing the aggregations on the server run much quicker, as it reduces the time spent in io. My longest running steps are currently io related. Reducing these steps have im...

Pug Reveal Slides I recently gave a presentation at the Big Brothers and Big Sisters Data Challenge. I wanted to use reveal to create my slides. I have used it before and it is a really nice package. Compared to PowerPoint it is much easier to incorporate interactive visualizations right into the presentation,easy to re factor and maintain slides. Since you are just working with text you can easily convert from a list of items on one slide to a set of slides. Avoiding Death by PowerPoint # [1] If you have not seen David JP Phillips Death By PowerPoint [2] TEDx, stop now and watch it. You will never look at slides the same again. Watching this video ruined me for watching presentations with these issues. Reveal is a tool that makes it very easy to follow these principles - You are the center of focus - Reduce clutter - Focus your users with - size - contrast Reduce clutter # [3] In the video David talks about reducing the number of points we have down to no more than 6. You...

Pycon 2017 Roundup Good afternoon fellow Data Geeks. Last week Pycon [1] released 141 videos of greatness. Here are my top picks from the event. #3 Kelsey Hightower - Keynote - Pycon 2017 # [2] https://www.youtube.com/watch?v=u_iAXzy3xBA&t=1795s [3] #2 Al Sweigart Yes, It’s Time to Learn Regular Expressions PyCon 2017 # [4] https://www.youtube.com/watch?v=abrcJ9MpF60 #1 Trey Hunner Readability Counts PyCon 2017 # [5] https://www.youtube.com/watch?v=knMg6G9_XCg What’s on Tap # [6] This afternoon we have a cup of from one of my favorite roasters Thirty Thiry Coffee. This [7] References: [1]: https://www.youtube.com/channel/UCrJhliKNQ8g0qoE_zvL8eVg [2]: #3-kelsey-hightower---keynote---pycon-2017 [3]: https://www.youtube.com/watch?v=u_iAXzy3xBA&t=1795s [4]: #2-al-sweigart-yes-its-time-to-learn-regular-expressions-pycon-2017 [5]: #1-trey-hunner-readability-counts-pycon-2017 [6]: #whats-on-tap [7]: https://www.thirty-thirtycoffee.com/