The past, present and future of containers by Timothy Chen

The past, present and future of containers
圖片出處: https://denibertovic.com/talks/supercharge-development-env-using-docker/img/what_is_docker.png

這次的 docker talk 中, Tim 跟我們分享了整個 container 在 linux 中發展的概念。

因為一些技術問題,影片最後有點被切掉,但是還有錄到 90% 的分享。

Talk 簡介

You’ve heard the term “containers.” Maybe you’ve heard the buzz surrounding new technologies like Docker and CoreOS. They plaster the front pages of HackerNews and reddit .

If you’ve wondered just what the big deal is and what they are, this is a simple, what, why, and a how-to for containerization and how you can use it with your application.

Simply put, containerization enables you to scale your apps with increasing ease. For developers, you can abstract away your infrastructure and stop worrying about developing, testing, and running in identical environments – it’s all the same inside your container.

講者

Timothy Chen - Distributed Systems Engineer

Timothy Chen – Distributed Systems Engineering Lead at Mesosphere

投影片

//speakerdeck.com/assets/embed.js

錄影

D3.js: the Core Concepts by Zero Cho

Special thanks to our sponsor:

Taulia drives innovation in the Financial Supply Chain. By turning every invoice into a revenue opportunity, Taulia enables organizations to strengthen supplier relationships while adding millions to the bottom line.

以前的記錄方式都是以聚會為單位,導致兩個以上不同 topic 的分享記錄有時候會寫在同一篇紀錄中,這樣對未來想要找資料的人來說,效果沒有很好。

因此,接下來的聚會記錄,會以 talk 為單位,把講師的錄影與提供的資料放在同一篇文章標題中,讓大家方便查詢。

首先,我們先來放 Zero 上上個月分享的 D3 吧!(太晚放是我的錯,Zero 不要打我~~~)

Talk 簡介

d3.js is a famous data visualization library. All the power of d3.js comes from its simplistic syntax and data binding. This talk will guide you through d3’s core concepts and its core function: data transformation. We will then use a network topology editor to showcase d3’s dynamic capability.

講者

Zero Cho

Zero Cho – Software Engineer at Twitter

投影片

//speakerdeck.com/assets/embed.js

錄影

歡迎大家留言討論,有任何新的留言,我們都會通知講師。

謝謝大家

[聚會 #6 – 26 Sep @ 2:30pm] The past, present and future of containers by Timothy Chen

The past, present and future of containers
The past, present, and the future of containers

主題介紹

這年頭,沒有聽過,看過,用過 docker 就好像是沒有用過 iPhone 一樣可恥,docker 能夠飛天,能夠鑽地,能夠幫你把你整個 data center 中所有執行中的程式搞得服服貼貼的,還能夠幫你看小孩,溜小狗,讓所有宅宅桌機都可以跑類似 production 一樣的環境,免掉著名的『在我的機器上可以跑啊,在你的機器上怎麼不行?』這種困擾。

docker 這麼好用,還不快去買?

但是你知道嗎?docker 只是 linux 支援的 container 之中的一種喔!!

趕!docker 就 docker!container 是啥東西?可以吃嗎?

賣緊張,這次我們又請到 Mesosphere 擔任 Distributed Systems Engineering Lead 的 Timothy Chen 來跟我們剖析 container 的過去,現在,與未來。讓你以後在公司狂電同事老闆,高人一等。

聚會議程

2:30 to 3pm getting ready 🙂

The past, present and future of containers

(3pm to 4pm, including QA)

You’ve heard the term “containers.” Maybe you’ve heard the buzz surrounding new technologies like Docker and CoreOS. They plaster the front pages of HackerNews and reddit . If you’ve wondered just what the big deal is and what they are, this is a simple, what, why, and a how-to for containerization and how you can use it with your application. Simply put, containerization enables you to scale your apps with increasing ease. For developers, you can abstract away your infrastructure and stop worrying about developing, testing, and running in identical environments – it’s all the same inside your container.

Timothy Chen – Distributed Systems Engineering Lead at Mesosphere

Timothy Chen - Distributed Systems Engineer
Timothy Chen

Hacking Software Engineer Interviews

(4pm to 5pm , including networking)

In the meet-up, Cheng-Tao will share his experience as an software engineer interviewer at various companies including Google, LinkedIn, Square, and Codecademy.

Particularly, what different characteristics that interviewers from companies at different stage are looking for, as well as, what signals he personally is looking for during his interviews.

The session will be interactive and questions will also be highly welcome. If there is enough time, Cheng-Tao will also share tips of how to engineers can better prepare themselves for the interviews and a brief introduction of his startup which is aiming at disrupting the traditional engineer hiring process.

Cheng-Tao
Cheng-Tao

Cheng-Tao Chu – Google, Linkedin, Square, and Director of Engineering at Codecademy, currently starting up oneinterview.io

 

時間

26 Sep 2015 @ 2:30 pm

地點

Industrial Technology Reserach Institute (ITRI)
2870 Zanker Road, Suite 140, San Jose, CA 95134, USA

參加方式

請愛用 Facebook Event 參加:
https://www.facebook.com/events/1615259208735612/

[聚會 #5 – 18 July @ 2pm] D3.js: the Core Concepts by Zero Cho

Data visualization with D3.js by Zero Cho
Data visualization with D3.js by Zero Cho

主題介紹

D3 早就已經是網頁資料視覺化的標準配備,幾年前還在前公司服務的時候, Sales Director 有天神秘兮兮地靠過來,喜孜孜地跟我們分享他在客戶那邊聽到的成功訣竅,就是公司產品做 charting 的時候可以使用 D3… XD

很可惜地,當初負責前端設計的工程師比較鍾意有商業支援的 highcharts ,錯失了實作 D3 的機會。

這次,爛熟 graph 的 Zero 繼上次聊完 routing 演算法後,這次跟我們分享 D3 的實作經驗,人真是太好了!

聚會議程

2pm – 2:30pm: Let’s do: d3.js: the Core Concepts
d3.js is a famous data visualization library. All the power of d3.js comes from its simplistic syntax and data binding. This talk will guide you through d3’s core concepts and its core function: data transformation. We will then use a network topology editor to showcase d3’s dynamic capability.

2:30pm – 3:30pm: Networking and side project time.

Zero Cho – Software Engineer at Twitter

Zero Cho

上次 Zero 在讀書肚的分享:[聚會 #2 – 紀錄] Routing OpenStreetMap – by Zero Cho

時間

18 July @ 2pm

地點

Taulia: 201 Mission St #900, San Francisco, CA 94105

參加方式

請愛用 Facebook 活動連結報名:

https://www.facebook.com/events/659584477511003/

[聚會 #4 – 紀錄] 0 to Kaggle in 30 minutes – by Ming Tsai and You-Cyuan Jhang

10304502_10153311050208400_8182449893298095470_n

多謝工研院美西分院的贊助,這次 data science 的讀書肚 meetup 才能順利舉辦。

0 to Kaggle in 30 minutes

就算很多人聽過資料科學家的究極競技場 Kaggle ,也不一定人人都下場競技過,Ming Tsai 跟 You-Cyuan Jhang 這次的 talk 把資料科學的:

  • data preparation
  • training set/test set split
  • model training using just PostgreSQL, SQL, and Madlib
  • Kaggle result submission
  • … 等

的所有步驟清楚地介紹與 Demo,我想聽完這次 talk ,大家都可以下場玩玩。

Ming Tsai 與 You-Cyuan Jhang 目前在找挑戰 deep learning 的夥伴,請有興趣的一起加入打怪。

Youtube 影片檔

投影片

[聚會 #4 – 20 June @ 2pm] 0 to Kaggle in 30 minutes – by Ming Tsai and You-Cyuan Jhang

主題介紹

Kaggle 是資料科學家(data scientist)的終極競技場,每天都有世界上各地的資料科學家把自己精心準備的 model 送上來競賽,爭奪各地企業或研究機構所提供的題目與獎金。

如果我跟你說只要你會 SQL 語法,再加上一點點工具的幫助,30 分鐘內,你就能夠上場較勁,那該有多好?

期待 Ming 跟 You-Cyuan 把這入場卷教給我們。

聚會議程

2pm – 2:30pm: Introduction to Kaggle with SQL, using Hawq and Madlib.

2:30pm – 3:30pm: Networking and side project time.

Ming Tsai – Sr. Data Engineer at Silicon Valley Data Science

Ming

 

You-Cyuan Jhang – Senior Data Science Engineer at Castlight Health

You-Cyuan Jhang

時間

20 June (Sat) @ 2pm

地點

2870 Zanker Rd, San Jose, California 95134 (北美工研院)

參加方式

請愛用 Facebook 活動連結報名:

https://www.facebook.com/events/846922662028117/

[聚會 #3 – 記錄] Apache Mesos and Apache Spark – by Tim Chen and Chu-Cheng Hsieh

謝謝大家上禮拜六的參加,以下是上禮拜 meetup 紀錄。

Modern Techniques in Big Data Science

Chu-Cheng Hsieh 的 talk 是我看過把大資料分析(與工具)講得最淺顯易懂的,不僅輕鬆帶過 map/reduce/flat 等基礎的 map/reduce 概念,從過去的 hadoop,pig,到現在的 Spark,鉅細彌遺地講述了這些工具演化的歷史原因,還透露了他面試的問題以及回答的技巧(疑!?),請想要複習的朋友,服用以下的影片紀錄 + 投影片:

影片

投影片

 

Note: Yelp 有自己出品的 mrjob (https://github.com/Yelp/mrjob),完全是 python based 的,有興趣可以玩玩看。

 

Introduction to Apache Mesos

如果你的 data center 的單位還是 VM ,你怎麼處理有些 VM 的 usage 只有 2% (只裝了一個測試用的 MySQL)的浪費?如果你的 data center 每季成長的幅度是 3 萬台,你怎麼設計這個複雜的管理系統,讓所有需要計算資源的工程師,都順利拿到資源?Mesos 就用 linux container 的方式刻出一個完美的 data center OS。

Note: Unplugged 以後,Tim 還分享了她如何從身為 Apache 專案 PMC 中,拿到很多創投贊助意願,以及 entrepreneur in residence 的機會。

影片

投影片

 

Side Projects

Ming 的三個 Side Project ,歡迎有興趣的人參加:

  1. pinemango https://pinemango.com/
  2. 教授百分百 http://bravoprofessor.com
  3. CouchMED https://couchmed.com/

[聚會 #3 – 16 May @ 2pm] Apache Mesos and Apache Spark – by Tim Chen and Chu-Cheng Hsieh

主題介紹

這個月是我們讀書肚的阿帕契(Apache)月,跟李蒨蓉沒有關係,是我們要介紹兩個最近紅透半邊天的 Apache Project:分散式/海量資料運算的 Apache Spark ,與 data center 專用的 Operation System,Apache Mesos

身為矽谷軟體工程師,談到 Big Data Analysis ,Machine Learning,或 Parallelism,你不能不知道當今 Yahoo,eBay,Neflix 爭相採用的 Apache Spark,談到 Data Center 的自動化或是 Resource Management ,你不能不知道現下 Airbnb,Twitter,Apple 趨之若鶩的 Apache Mesos

這次,讀書肚一次帶給你。

聚會議程

Apache Spark(2:15 pm to 2:45 pm)

Modern Techniques in Big Data Science

Apache Spark is becoming one of the most gossiping and the state-of-the-art framework to conduct data analysis on Hadoop platform. in this talk. I will discuss why PIG is fading out and why Java is not suitable for the big data analysis these days. Next, I will start with explaining the basic idea/motivation behind big data analysis (in my perspective), followed by explaining operations like “map, reduce, fold, join, etc.” and wrapped up with real world examples, including page rank calculation and clustering data sets.

Chu-Cheng Hsieh – Applied Researcher at eBay

Chu-Cheng Hsieh - Applied Researcher at eBay

Apache Mesos(2:45 pm to 3:15pm)

Introduction to Apache Mesos

Come learn how Apache Mesos, an open source distributed cluster
manager, can allow Twitter to have only three full-time SREs to manage
10s of thousands of nodes running in their datacenters and achieve
high utilization.

Timothy Chen – Distributed Systems Engineer

Timothy Chen - Distributed Systems Engineer

時間

16 May @ 2pm

地點

超級感謝 Salesforce 的 Benjamin Tsai 大力幫忙喬場地,我們這次在 Salesforce Rincon Center 一樓的 Cafe / meeting room 空間舉行,確切地點請點我看地圖

到達 Rincon Center 後請來電通知 Winston (四一五,四零一,五一三五),因為門是鎖住的,我們必須要過去接你進來。

請在下圖這個門這邊打給我:

Salesforce

遠道而來到朋友們,Rincon Center 地下室也有停車場,收費 10 元。

參加方式

請愛用 Facebook Event Page 參加,因為要控制人數,所以請想來的人按下『參加』喔:

https://www.facebook.com/events/387598671435364/

[聚會 #2 – 紀錄] Routing OpenStreetMap – by Zero Cho

抱歉,這禮拜超級給他忙的!上禮拜日舉辦的 meetup ,週五晚上才有時間來寫一下紀錄。

首先,感謝在 Twitter的 Zero 分享,這次參加的人數比上次多了一倍 XD,請笑納 meetup 的投影片:

//speakerdeck.com/assets/embed.js

沒有到現場的朋友們,也可以觀看當天的影片,Zero 真的把很繁雜的地圖演算法,講解得非常簡單有趣(亞特蘭大治安這麼差嗎?)

#3 聚會暫定在 5/16 2pm ,在舊金山市區舉行,除了有趣的講題以外,我們也會在流程上做出一些調整,讓大家能夠更容易了解彼此的背景與目前在碰的技術或是專案。

我們下次見了 😉

[聚會 #2 – 12 Apr @ 2pm] Routing OpenStreetMap – by Zero Cho

主題介紹

Routing OpenStreetMap

為了防止邪惡的企業勢力摧毀地球,開放社群們的勇者自 2004 年以來,磨著 OpenStreetMap 這把劍,對抗 Google 的 Google Maps (儘管我很愛用 XD),Microsoft 的 Bing Maps ,Yahoo 的 Yahoo Maps,與 Apple MacOS/iOS 上面的 Maps,圖的就是一個不屬於任何財團,跟 Wikipedia 一樣大家都可以貢獻的世界地圖 App。

這次,讀書肚很榮幸邀請到在 Twitter 的 Zero Cho 跟我們分享他在 OpenStreetMap 上面開發 routing 所使用的演算法,資料庫,與 API。

預設大綱

  • A quick recap on Graph
  • How is routing done?
  • How do we improve it?
  • Moving to neo4j
  • QA

時間:

12 April (Sun) 2PM

地點:

848 San Ramon Ave Sunnyvale, CA 94085
(Startup團隊:Hibiki 的巢穴,大感激Hibiki 願意出借場地)

講者介紹

Zero Cho
Zero Cho

Zero Cho,剛從 Georgia Tech 畢業,由亞特蘭大搬到加州開始在 Twitter 上班的新生活。

工作上是作為改善網站測試系統、佈署流程的工程師,但平時也喜歡研究各種資訊領域相關科技、做做手機程式開發等等。

預習文件下載

RoutingOSM – 投影片

另外,請大家申請加入我們的 Facebook Group