ADA Lab @ UCSD

Project Triptych

Overview

Triptych is an end-to-end model selection management system (MSMS) that aims to simplify and accelerate the process of sourcing data/features and selecting ML models. Our guiding principles are to exploit the semantics of the data and the ML task to the extent possible to reduce work for the data scientist and reduce runtimes and costs. We apply these principles to remove or mitigate different bottlenecks in this end-to-end process, eventually unifying these components to yield an integrated ‘‘operating system’’ for ML analytics tasks. Please refer to the ACM SIGMOD Record paper below for more details of this vision.

Active Component Projects

Cerebro Efficient and reproducible model selection on deep learning systems.

Morpheus Integrating linear algebra and relational algebra to simplify feature engineering for ML.

SortingHat ML schema inference and automatic data preparation.

Publications

• Towards Benchmarking Feature Type Inference for AutoML Platforms
  Vraj Shah, Jonathan Lacanlale, Premanand Kumar, Kevin Yang, and Arun Kumar
  SIGMOD 2021 (To appear) | Paper PDF | TechReport | Data, Code, and Pre-trained Models on GitHub | Python library

• Towards A Polyglot Framework for Factorized ML
  David Justo, Shaoqing Yi, Lukas Stadler, Nadia Polikarpova, and Arun Kumar
  VLDB 2021 (Industrial Track; to appear) | Paper PDF coming soon | TechReport | Code coming soon

• Application of Convolutional Neural Network Algorithms for Advancing Sedentary and Activity Bout Classification
  Supun Nakandala, Marta Jankowska, Fatima Tuz-Zahra, John Bellettiere, Jordan Carlson, Andrea LaCroix, Sheri Hartman, Dori Rosenberg, Jingjing Zou, Arun Kumar, and Loki Natarajan
  Journal for the Measurement of Physical Behaviour | Paper PDF | Code

• Cerebro: A Layered Data Platform for Scalable Deep Learning
  Arun Kumar, Supun Nakandala, Yuhao Zhang, Side Li, Advitya Gemawat, and Kabir Nagrecha
  CIDR 2021 (Vision paper) | Paper PDF | Talk video

• Cerebro: A Data System for Optimized Deep Learning Model Selection
  Supun Nakandala, Yuhao Zhang, and Arun Kumar
  VLDB 2020 | Paper PDF | Errata | TechReport | Talk videos: Youtube Bilibili | Blog post | SAIS Talk video | Source code and documentation

• Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra
  Side Li, Lingjiao Chen, and Arun Kumar
  ACM SIGMOD 2019 | Paper PDF | Code and Data on Github

• Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent
  Fengan Li, Lingjiao Chen, Yijing Zeng, Arun Kumar, Jeffrey Naughton, Jignesh Patel, and Xi Wu
  ACM SIGMOD 2019 | Paper PDF | TechReport | Code on GitHub

• Model-based Pricing for Machine Learning in a Data Marketplace
  Lingjiao Chen, Paraschos Koutris, and Arun Kumar
  ACM SIGMOD 2019 | Paper PDF | TechReport | Code and Data coming soon

• Cerebro: Efficient and Reproducible Model Selection on Deep Learning Systems
  Supun Nakandala, Yuhao Zhang, and Arun Kumar
  ACM SIGMOD 2019 DEEM Workshop | Paper PDF | TechReport | Blog post

• The ML Data Prep Zoo: Towards Semi-Automatic Data Preparation for ML
  Vraj Shah and Arun Kumar
  ACM SIGMOD 2019 DEEM Workshop | Paper PDF | TechReport | Blog post | Data Prep Zoo Repository on GitHub

• Demonstration of Nimbus: Model-based Pricing for Machine Learning in a Data Marketplace
  Lingjiao Chen, Hongyi Wang, Leshang Chen, Paraschos Koutris, and Arun Kumar
  ACM SIGMOD 2019 Demo | Paper PDF | Video coming soon

• A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics
  Anthony Thomas and Arun Kumar
  VLDB 2018/2019 | Paper PDF | TechReport | Code and Data

• Are Key-Foreign Key Joins Safe to Avoid when Learning High-Capacity Classifiers?
  Vraj Shah, Arun Kumar, and Xiaojin Zhu.
  VLDB 2018 | Paper PDF | TechReport | Code and Data

• Towards Linear Algebra over Normalized Data
  Lingjiao Chen, Arun Kumar, Jeffrey Naughton, and Jignesh Patel
  VLDB 2017 | Paper PDF | TechReport | Code and Data

• Model-based Pricing: Do Not Pay for More than What You Learn!
  Lingjiao Chen, Paraschos Koutris, and Arun Kumar
  ACM SIGMOD 2017 DEEM Workshop | Paper PDF

• Cerebro: A System to Manage Deep Learning for Relational Data Analytics
  Arun Kumar
  CIDR 2017 Abstract | Paper PDF

• To Join or Not to Join? Thinking Twice about Joins before Feature Selection
  Arun Kumar, Jeffrey Naughton, Jignesh M. Patel, and Xiaojin Zhu
  ACM SIGMOD 2016 | Paper PDF | TechReport | Code and Data

• Model Selection Management Systems: The Next Frontier of Advanced Analytics
  Arun Kumar, Robert McCann, Jeffrey Naughton, and Jignesh M. Patel
  ACM SIGMOD Record Dec 2015 Vision Track | Paper PDF

Technical Reports

• Intermittent Human-in-the-Loop Model Selection using Cerebro: A Demonstration
  Liangde Li, Supun Nakandala, and Arun Kumar
  Under submission | TechReport

• Optimizing Large-Scale Machine Learning over Groups
  Side Li and Arun Kumar
  Under submission | TechReport

• Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches
  Yuhao Zhang, Arun Kumar, Frank McQuillan, Nandish Jayaram, Nikhil Kak, Ekta Khanna, Orhan Kislal, and Domino Valdano
  Under submission | TechReport | Code release

• Improving Feature Type Inference Accuracy of TFDV with SortingHat
  Vraj Shah, Kevin Yang, and Arun Kumar
  TechReport

Past Projects

Hamlet Exploiting database schema information to simplify data sourcing.

Nimbus Enabling the first ML-aware cloud-based commodity market for the new black gold: training data.

SLAB The first comprehensive benchmark comparison of scalable linear algebra systems.