Write a Blog >>
PLDI 2020
Mon 15 - Fri 19 June 2020
Thu 18 Jun 2020 11:00 - 11:20 at PLDI Research Papers live stream - Machine Learning II Chair(s): Ke Wang

This paper introduces the MCML approach for empirically studying
the learnability of relational properties that can be
expressed in the well-known software design language Alloy. A
key novelty of MCML is quantification of the performance of and semantic
differences among trained machine learning (ML) models, specifically
decision trees, with respect to entire (bounded) input spaces,
and not just for given training and test
datasets (as is the common practice). MCML reduces the quantification
problems to the classic complexity theory problem of model counting, and employs state-of-the-art model
counters. The results show that relatively simple
ML models can achieve surprisingly high performance (accuracy and F1-score)
when evaluated in the common setting of using
training and test datasets – even when the training dataset is
much smaller than the test dataset – indicating the seeming
simplicity of learning relational properties. However, MCML
metrics based on model counting show that the performance can degrade
substantially when tested against the entire (bounded) input space,
indicating the high complexity of precisely learning these properties,
and the usefulness of model counting in quantifying the true performance.

Thu 18 Jun
Times are displayed in time zone: (GMT-07:00) Pacific Time (US & Canada) change

10:40 - 11:40: PLDI Research Papers - Machine Learning II at PLDI Research Papers live stream
Chair(s): Ke WangVisa Research

YouTube lightning session video

pldi-2020-papers10:40 - 11:00
Samuel DrewsUniversity of Wisconsin-Madison, USA, Aws AlbarghouthiUniversity of Wisconsin-Madison, USA, Loris D'AntoniUniversity of Wisconsin-Madison, USA
pldi-2020-papers11:00 - 11:20
Muhammad UsmanUniversity of Texas at Austin, USA, Wenxi WangUniversity of Texas at Austin, USA, Marko VasicUniversity of Texas at Austin, USA, Kaiyuan WangGoogle, USA, Haris VikaloUniversity of Texas at Austin, USA, Sarfraz KhurshidUniversity of Texas at Austin, USA
pldi-2020-papers11:20 - 11:40
Jingxuan HeETH Zurich, Switzerland, Gagandeep SinghETH Zurich, Switzerland, Markus PüschelETH Zurich, Switzerland, Martin VechevETH Zurich, Switzerland