Chiyuan Zhang

According to our database, Chiyuan Zhang authored at least 62 papers between 2010 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of three.

2024

Localizing Paragraph Memorization in Language Models.

Niklas Stoehr, Mitchell Gordon, Chiyuan Zhang, Owen Lewis

CoRR, 2024

How Private is DP-SGD?

Lynn Chua, Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Amer Sinha, Chiyuan Zhang

CoRR, 2024

Training Differentially Private Ad Prediction Models with Semi-Sensitive Features.

Lynn Chua, Qiliang Cui, Badih Ghazi, Charlie Harrison, Pritish Kamath, Walid Krichene, Ravi Kumar, Pasin Manurangsi, Krishna Giri Narra, Amer Sinha, Avinash V. Varadarajan, Chiyuan Zhang

CoRR, 2024

2023

Counterfactual Memorization in Neural Language Models.

Chiyuan Zhang, Daphne Ippolito, Katherine Lee, Matthew Jagielski, Florian Tramèr, Nicholas Carlini

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Optimal Unbiased Randomizers for Regression with Label Differential Privacy.

Ashwinkumar Badanidiyuru Varadaraja, Badih Ghazi, Pritish Kamath, Ravi Kumar, Ethan Leeman, Pasin Manurangsi, Avinash V. Varadarajan, Chiyuan Zhang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

User-Level Differential Privacy With Few Examples Per User.

Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Raghu Meka, Chiyuan Zhang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Sparsity-Preserving Differentially Private Training of Large Embedding Models.

Badih Ghazi, Yangsibo Huang, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Amer Sinha, Chiyuan Zhang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Preventing Generation of Verbatim Memorization in Language Models Gives a False Sense of Privacy.

Daphne Ippolito, Florian Tramèr, Milad Nasr, Chiyuan Zhang, Matthew Jagielski, Katherine Lee, Christopher A. Choquette-Choo, Nicholas Carlini

Proceedings of the 16th International Natural Language Generation Conference, 2023

Can Neural Network Memorization Be Localized?

Pratyush Maini, Michael Curtis Mozer, Hanie Sedghi, Zachary Chase Lipton, J. Zico Kolter, Chiyuan Zhang

Proceedings of the International Conference on Machine Learning, 2023

On User-Level Private Convex Optimization.

Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Raghu Meka, Chiyuan Zhang

Proceedings of the International Conference on Machine Learning, 2023

Measuring Forgetting of Memorized Training Examples.

Matthew Jagielski, Om Thakkar, Florian Tramèr, Daphne Ippolito, Katherine Lee, Nicholas Carlini, Eric Wallace, Shuang Song, Abhradeep Guha Thakurta, Nicolas Papernot, Chiyuan Zhang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Regression with Label Differential Privacy.

Badih Ghazi, Pritish Kamath, Ravi Kumar, Ethan Leeman, Pasin Manurangsi, Avinash V. Varadarajan, Chiyuan Zhang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Quantifying Memorization Across Neural Language Models.

Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramèr, Chiyuan Zhang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Ticketed Learning-Unlearning Schemes.

Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Ayush Sekhari, Chiyuan Zhang

Proceedings of the Thirty Sixth Annual Conference on Learning Theory, 2023

Private Ad Modeling with DP-SGD.

Carson Denison, Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Krishna Giri Narra, Amer Sinha, Avinash V. Varadarajan, Chiyuan Zhang

Proceedings of the Workshop on Data Mining for Online Advertising (AdKDD 2023) co-located with the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2023), 2023

2022

Are All Layers Created Equal?

Chiyuan Zhang, Samy Bengio, Yoram Singer

J. Mach. Learn. Res., 2022

Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy.

Daphne Ippolito, Florian Tramèr, Milad Nasr, Chiyuan Zhang, Matthew Jagielski, Katherine Lee, Christopher A. Choquette-Choo, Nicholas Carlini

CoRR, 2022

Just Fine-tune Twice: Selective Differential Privacy for Large Language Models.

Weiyan Shi, Si Chen, Chiyuan Zhang, Ruoxi Jia, Zhou Yu

CoRR, 2022

Understanding and Improving Robustness of Vision Transformers through Patch-based Negative Augmentation.

Yao Qin, Chiyuan Zhang, Ting Chen, Balaji Lakshminarayanan, Alex Beutel, Xuezhi Wang

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

The Privacy Onion Effect: Memorization is Relative.

Nicholas Carlini, Matthew Jagielski, Chiyuan Zhang, Nicolas Papernot, Andreas Terzis, Florian Tramèr

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Learning to Reason with Neural Networks: Generalization, Unseen Data and Boolean Measures.

Emmanuel Abbe, Samy Bengio, Elisabetta Cornacchia, Jon M. Kleinberg, Aryo Lotfi, Maithra Raghu, Chiyuan Zhang

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Just Fine-tune Twice: Selective Differential Privacy for Large Language Models.

Weiyan Shi, Ryan Shea, Si Chen, Chiyuan Zhang, Ruoxi Jia, Zhou Yu

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Deduplicating Training Data Makes Language Models Better.

Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, Nicholas Carlini

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization.

Chiyuan Zhang, Maithra Raghu, Jon M. Kleinberg, Samy Bengio

CoRR, 2021

Understanding deep learning (still) requires rethinking generalization.

Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, Oriol Vinyals

Commun. ACM, 2021

Do Vision Transformers See Like Convolutional Neural Networks?

Maithra Raghu, Thomas Unterthiner, Simon Kornblith, Chiyuan Zhang, Alexey Dosovitskiy

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Deep Learning with Label Differential Privacy.

Badih Ghazi, Noah Golowich, Ravi Kumar, Pasin Manurangsi, Chiyuan Zhang

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Understanding Invariance via Feedforward Inversion of Discriminatively Trained Classifiers.

Piotr Teterwak, Chiyuan Zhang, Dilip Krishnan, Michael C. Mozer

Proceedings of the 38th International Conference on Machine Learning, 2021

Characterizing Structural Regularities of Labeled Data in Overparameterized Models.

Ziheng Jiang, Chiyuan Zhang, Kunal Talwar, Michael C. Mozer

Proceedings of the 38th International Conference on Machine Learning, 2021

2020

Exploring the Memorization-Generalization Continuum in Deep Learning.

Ziheng Jiang, Chiyuan Zhang, Kunal Talwar, Michael C. Mozer

CoRR, 2020

What is being transferred in transfer learning?

Behnam Neyshabur, Hanie Sedghi, Chiyuan Zhang

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation.

Vitaly Feldman, Chiyuan Zhang

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Identity Crisis: Memorization and Generalization Under Extreme Overparameterization.

Chiyuan Zhang, Samy Bengio, Moritz Hardt, Michael C. Mozer, Yoram Singer

Proceedings of the 8th International Conference on Learning Representations, 2020

2019

Transfusion: Understanding Transfer Learning with Applications to Medical Imaging.

Maithra Raghu, Chiyuan Zhang, Jon M. Kleinberg, Samy Bengio

CoRR, 2019

Identity Crisis: Memorization and Generalization under Extreme Overparameterization.

Chiyuan Zhang, Samy Bengio, Moritz Hardt, Yoram Singer

CoRR, 2019

Transfusion: Understanding Transfer Learning for Medical Imaging.

Maithra Raghu, Chiyuan Zhang, Jon M. Kleinberg, Samy Bengio

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

A Novel Hierarchical Collaborative Method Based on Multi-objective Optimization for Modularization of Product Platform.

Qihao Wan, Jiaxin Zhao, Jianru Xue, Chiyuan Zhang, Bin He, Heming Zhang

Proceedings of the 23rd IEEE International Conference on Computer Supported Cooperative Work in Design, 2019

2018

Deep learning and structured data.

Chiyuan Zhang

PhD thesis, 2018

Unrestricted Adversarial Examples.

Tom B. Brown, Nicholas Carlini, Chiyuan Zhang, Catherine Olsson, Paul F. Christiano, Ian J. Goodfellow

CoRR, 2018

A Study on Overfitting in Deep Reinforcement Learning.

Chiyuan Zhang, Oriol Vinyals, Rémi Munos, Samy Bengio

CoRR, 2018

Theory of Deep Learning IIb: Optimization Properties of SGD.

Chiyuan Zhang, Qianli Liao, Alexander Rakhlin, Brando Miranda, Noah Golowich, Tomaso A. Poggio

CoRR, 2018

Machine Theory of Mind.

Neil C. Rabinowitz, Frank Perbet, H. Francis Song, Chiyuan Zhang, S. M. Ali Eslami, Matthew M. Botvinick

Proceedings of the 35th International Conference on Machine Learning, 2018

2017

Decentralized State-Observer-Based Traffic Density Estimation of Large-Scale Urban Freeway Network by Dynamic Model.

Yuqi Guo, Yangzhou Chen, Chiyuan Zhang

Inf., 2017

Distributed state-observer-based traffic density estimation of urban freeway network.

Yuqi Guo, Yangzhou Chen, Wei Li, Chiyuan Zhang

Proceedings of the 20th IEEE International Conference on Intelligent Transportation Systems, 2017

Understanding deep learning requires rethinking generalization.

Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, Oriol Vinyals

Proceedings of the 5th International Conference on Learning Representations, 2017

2016

A-Optimal Projection for Image Representation.

Xiaofei He, Chiyuan Zhang, Lijun Zhang, Xuelong Li

IEEE Trans. Pattern Anal. Mach. Intell., 2016

Training Deep Nets with Sublinear Memory Cost.

Tianqi Chen, Bing Xu, Chiyuan Zhang, Carlos Guestrin

CoRR, 2016

2015

MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems.

Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, Zheng Zhang

CoRR, 2015

Learning with a Wasserstein Loss.

Charlie Frogner, Chiyuan Zhang, Hossein Mobahi, Mauricio Araya-Polo, Tomaso A. Poggio

Proceedings of the Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, 2015

Discriminative template learning in group-convolutional networks for invariant speech representations.

Chiyuan Zhang, Stephen Voinea, Georgios Evangelopoulos, Lorenzo Rosasco, Tomaso A. Poggio

Proceedings of the INTERSPEECH 2015, 2015

2014

Learning An Invariant Speech Representation.

Georgios Evangelopoulos, Stephen Voinea, Chiyuan Zhang, Lorenzo Rosasco, Tomaso A. Poggio

CoRR, 2014

Phone classification by a hierarchy of invariant representation layers.

Chiyuan Zhang, Stephen Voinea, Georgios Evangelopoulos, Lorenzo Rosasco, Tomaso A. Poggio

Proceedings of the INTERSPEECH 2014, 2014

Word-level invariant representations from acoustic waveforms.

Stephen Voinea, Chiyuan Zhang, Georgios Evangelopoulos, Lorenzo Rosasco, Tomaso A. Poggio

Proceedings of the INTERSPEECH 2014, 2014

A deep representation for invariance and music classification.

Chiyuan Zhang, Georgios Evangelopoulos, Stephen Voinea, Lorenzo Rosasco, Tomaso A. Poggio

Proceedings of the IEEE International Conference on Acoustics, 2014

2013

Image Compression by Learning to Minimize the Total Error.

Chiyuan Zhang, Xiaofei He

IEEE Trans. Circuits Syst. Video Technol., 2013

Parallel vector field embedding.

Binbin Lin, Xiaofei He, Chiyuan Zhang, Ming Ji

J. Mach. Learn. Res., 2013

Combining Active and Semi-Supervised Learning for Video Compression.

Chiyuan Zhang, Ming Ji

Int. J. Softw. Informatics, 2013

2012

Multi-task Vector Field Learning.

Binbin Lin, Sen Yang, Chiyuan Zhang, Jieping Ye, Xiaofei He

Proceedings of the Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held December 3-6, 2012

2011

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization.

Xiaofei He, Ming Ji, Chiyuan Zhang, Hujun Bao

IEEE Trans. Pattern Anal. Mach. Intell., 2011

Semi-supervised Regression via Parallel Field Regularization.

Binbin Lin, Chiyuan Zhang, Xiaofei He

Proceedings of the Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011. Proceedings of a meeting held 12-14 December 2011, 2011

Orthogonal Projection Analysis.

Binbin Lin, Chiyuan Zhang, Xiaofei He

Proceedings of the Intelligent Science and Intelligent Data Engineering, 2011

2010

Unsupervised feature selection for multi-cluster data.

Deng Cai, Chiyuan Zhang, Xiaofei He

Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2010