Big Data in Egypt, Hype or Reality? Sameh El-Ansary, PhD (Teacher of What’s not BigData) About Sameh El-Ansary • Researcher: – PhD in Large-Scale Distributed Systems, KTH, SWEDEN – Researcher at the Swedish Institute of Computer Science, SICS • Teacher: – KTH: P2P, Distributed Algorithms – Nile University: Security, SwEng, Network Programming, BigData. Designed the 1st professional diploma in BigData and Data Science in Egypt • Entrepreneur: – Co-founder of Hive Streaming (successful exit): P2P live streaming for corporates. Used by global corporation like: Facebook, Ericsson, PepsiCo and Kellogg’s – Co-founder of Scalable-Learning: Help universities compete with MOOCs – Co-founder of Racefox: AI coach for Skiing, Running – Founder of Novelari Innovation Accelerator: Helping Swedish & Egyptian startups with hard technical questions and business-focused development in areas like: Cloud Architecture, Big Data, AI and Data Science. How every talk on BigData Starts? • Big Data is booming!! • Big Data is the future!! • You should learn BigData Engineering!! • BigData jobs are increasing!! • You should use BigData tools in your corporate!! • You should make a BigData startup!! • !! • !! • !! … So.. Is all this “!!” real? • Mmm ..., YES, it is a multi-billion dollar industry • It is a skill in high-demand all over the world ME • The question is: “Is knowing/using Big Data good for ?” – A fresh computer science/IT graduate – A fresh engineering graduate – A corporate/startup junior developer – A corporate/startup senior db/warehouse professional – Network administrator – Someone in another field, engineering, chemistry, medicine and looking to change career? • For all of the above? The hype can – NO, NO, NO and for some, it is hype and affect you negatively!! This Talk • Is not about the greatness of BigData Engineering, I trust the rest of the workshop in showing this. • Its is about sharing experience of Egyptian/European students, professionals, companies who decided to got into the BigData field • The talk is subjective, based on my personal sample space And.. • Before we start… – We do not learn BigData… – We learn BigData Engineering, Tools, and Analytics DATA SCIENCE OR ENGINEERING? Data Science Vs (Big)Data Eng. Data Science Big Data Engineering Maths and algorithmic skills Programming and Systems Skills Science + Bit of tech Technology Won’t change Will definitely change Vendor/Tech-agnostic Vendor-specific Needed for Real life apps Needed for Real life apps Goal Tool Relevant for Big or Small Data Relevant for Big Data Only Extracting insights/value Solving scalability, heterogeneity, etc.. R, PyData, Visualization Hadoop, Spark, etc.. Regression, Classification, Wordcount, Indexing, ML at scale Clustering, Neural Netowkrs, etc.. Needs data engineering to scale Helps Data Science Let’s Play: Data Sci or Eng? • Predicting the sales of next year • Scaling up/out a data warehouse • Detecting credit card fraud from logs • Credit worthiness evaluation • Building data models for OLAP BIG DATA – AN ENGINEERING PERSPECTIVE
Description: