CMS Research Course

Topic: BigData, Cloud and Mobile System Platforms

    Grading: letter grade 

    • 20%: Presentation - (Key concepts + practice)
    • 80%: Research project


    BigData/Cloud

    • Dataflow - Spark Core (재성), Tez, Hadoop MR
    • ML - GraphLab (기정), Spark MLlib (우연), Parameter Server (주성), DNN (주성)
    • SQL on a Dataflow Engine - Hive/Tez, SparkSQL/Spark
    • Streaming - Storm (태건), SparkStreaming (계원)
    • Deployment/Management - Slider (윤성)
    • Programming layer - Spark PL (조박사님), Google Cloud Dataflow (based on FlumeJava)
    • Container Technology (영석) - Docker, LinuxContainer, ControlGroups, etc.
    • Resource Manager (영석) - YARN, Mesos
    • Distributed File System - HDFS (윤성)
    • NoSQL - HBase (재성)
    • Coordination - Zookeeper (태건)
    • KV -  Redis (계원), Memcache
    • Graph - GraphX (기정), Giraph
    • Workflow manager - Oozie, Azkaban
    BigData/Cloud action items
    • Execute research projects

    • Coordinate contribution to REEF (Java)

    • Implement key services

    • Build specialized analytics engines

    • Start to work on REEF ng (!)

    • Finish up the REEF journal paper

    Mobile/IoT

    • Android OS. Android L? (우연)
    • IoT OS?
    • Dalvik, ART, LLVM (태훈)
    • SELinux/SEAndroid (현민)
    • TaintDroid++ 
    • Native code tracking
    • Reverse Engineering Tools (서윤, 태훈) - IDAPro
    • Obfuscator
    • Decompiler (smali) (서윤, 태훈)
    • Mobile/IoT + Cloud?

    Mobile/IoT action items

    • Execute research projects

    • ASA submission

    • SMP submission


    Schedule
     Week# TuesdayThursday  Note
     1Introduction/PlanningNetworkService/Shuffle talk
     
     2Project proposalsGraphLab (기정) 
     3 Android OS (우연) 
     4Zookeeper(태건)Spark Core (재성) 
     5Cluster mgmt (계원)SEAndroid (현민) 
     6 (4/5-4/11)Spark core (재성)Reverse Engineering Tools (서윤, 태훈) 
     7 (4/12-4/18)Data processing confData processing conf 
     8 (4/19-4/25)Data processing confDecompiler (서윤, 태훈) 
     9 (4/26-5/2)Spark MLlib (우연)Project presentation (4/28) 
     10 (5/3-5/9)Parameter Server (주성)/ DNN (주성)
    HBase (재성)OOT
     11 (5/10-5/16)Tez/HDFS (윤성)SparkStreaming(계원) 
     12 (5/17-5/23)Storm (태건) Project check Container (영석) Resource Manager (영석)   OOT
     13 (5/24-5/30)GraphX (기정) Container/Resource Manager (영석) BlueDBM 
     14 (5/31-6/6)Parameter Server / DNN (주성) Dalvik, ART, LLVM (태훈, 서윤, 우연) 
     15 (6/7-6/13) Project presentation (6/9)REEF .NET 
     16