ARC Colloquium: Vidya Muthukumar (Georgia Tech)

*********************************
There is now a CONTENT FREEZE for Mercury while we switch to a new platform. It began on Friday, March 10 at 6pm and will end on Wednesday, March 15 at noon. No new content can be created during this time, but all material in the system as of the beginning of the freeze will be migrated to the new platform, including users and groups. Functionally the new site is identical to the old one. webteam@gatech.edu
*********************************

Event Details
  • Date/Time:
    • Monday October 25, 2021
      11:00 am - 12:00 pm
  • Location: Groseclose 402
  • Phone:
  • URL:
  • Email:
  • Fee(s):
    N/A
  • Extras:
Contact
No contact information submitted.
Summaries

Summary Sentence: Surprises in high-dimensional linear classification - Groseclose 402 at 11am

Full Summary: No summary paragraph submitted.

Algorithms & Randomness Center (ARC)

Vidya Muthukumar (Georgia Tech)

Monday, October 25, 2021

Groseclose 402 - 11:00 am

 

Title:  Surprises in high-dimensional linear classification

Abstract: Seemingly counter-intuitive phenomena in deep neural networks and kernel methods have prompted a recent re-investigation of classical machine learning methods, like linear models. Of particular focus is sufficiently high-dimensional setups in which interpolation of training data is possible. In this talk, we will first briefly review recent works showing that zero regularization, or fitting of noise, need not be harmful in regression tasks. Then, we will use this insight to uncover two new surprises for high-dimensional linear classification:

  • least-2-norm interpolation can classify consistently even when the corresponding regression task fails, and
  • the support-vector-machine and least-2-norm interpolation solutions exactly coincide in sufficiently high-dimensional linear model.

These findings taken together imply that the linear SVM can generalize well in settings beyond those predicted by training-data-dependent complexity measures.

This is joint work with Misha Belkin, Daniel Hsu, Adhyyan Narang, Anant Sahai, Vignesh Subramanian, Christos Thrampoulidis, Ke Wang and Ji Xu.

----------------------------------

Speaker's Webpage

Videos of recent talks are available at: https://smartech.gatech.edu/handle/1853/46836

Click here to subscribe to the seminar email list: arc-colloq@Klauscc.gatech.edu

Additional Information

In Campus Calendar
No
Groups

ARC

Invited Audience
Faculty/Staff, Postdoc, Graduate students, Undergraduate students
Categories
Seminar/Lecture/Colloquium
Keywords
No keywords were submitted.
Status
  • Created By: Francella Tonge
  • Workflow Status: Published
  • Created On: Oct 11, 2021 - 10:14am
  • Last Updated: Oct 19, 2021 - 12:29pm