Publications

You can also find my articles on my Google Scholar profile.

Pareto-Secure Machine Learning (PSML): Fingerprinting and Securing Inference Serving Systems

Published in arXiv preprint arXiv:2307.01292, 2023

With the emergence of large foundational models, model-serving systems are becoming popular. In such a system, users send the queries to the server and specify the desired performance metrics (e.g., accuracy, latency, etc.). The server maintains a set of models (model zoo) in the back-end and serves the queries based on the specified metrics. This paper examines the security, specifically robustness against model extraction attacks, of such systems. We propose a query-efficient fingerprinting algorithm to enable the attacker to trigger any desired model consistently. We show that by using our fingerprinting algorithm, model extraction can have fidelity and accuracy scores within 1% of the scores obtained if attacking in a single-model setting and up to 14.6% gain in accuracy and up to 7.7% gain in fidelity compared to the naive attackā€¦..

Recommended citation: arXiv:2307.01292 https://arxiv.org/abs/2307.01292

Examinator v3.0: Cheating Detection in Online Take-Home Exams

Published in Proceedings of the Tenth ACM Conference on Learning @ Scale, 2023

Examinator v3.0 detects cheating in online take-home exams by comparing answers and the timestamps they were entered. A web interface enables efficient manual inspection. Use of the tool reveals that certain question types substantially enhance cheating detection, demonstrating the potential of automated algorithmic detection at scale. Examinator v3.0 has analyzed 915,831 pairs of exam submissions across three courses over two semesters at a top U.S. institution, identifying 46 instances of cheating.

Recommended citation: Hung, Jui-Tse, et al. "Examinator v3. 0: Cheating Detection in Online Take-Home Exams." Proceedings of the Tenth ACM Conference on Learning@ Scale. 2023. https://dl.acm.org/doi/10.1145/3573051.3596196