Ali Ghodsi
Orcid: 0000-0003-1866-246XAffiliations:
- University of Waterloo
According to our database1,
Ali Ghodsi
authored at least 121 papers
between 2002 and 2024.
Collaborative distances:
Collaborative distances:
Timeline
Legend:
Book In proceedings Article PhD thesis Dataset OtherLinks
Online presence:
-
on uwaterloo.ca
-
on orcid.org
On csauthors.net:
Bibliography
2024
QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning.
CoRR, 2024
WERank: Towards Rank Degradation Prevention for Self-Supervised Learning Using Weight Regularization.
CoRR, 2024
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference.
Proceedings of the Findings of the Association for Computational Linguistics: EACL 2024, 2024
2023
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference Using Sorted Fine-Tuning (SoFT).
CoRR, 2023
SortedNet, a Place for Every Network and Every Network in its Place: Towards a Generalized Solution for Training Many-in-One Neural Networks.
CoRR, 2023
CoRR, 2023
Improved knowledge distillation by utilizing backward pass knowledge in neural networks.
CoRR, 2023
DyLoRA: Parameter-Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation.
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023
Springer, ISBN: 978-3-031-10601-9, 2023
2022
Towards Understanding Label Regularization for Fine-tuning Pre-trained Language Models.
CoRR, 2022
KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation.
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022
Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022
Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022
Proceedings of the 29th International Conference on Computational Linguistics, 2022
Theoretical Connection between Locally Linear Embedding, Factor Analysis, and Probabilistic PCA.
Proceedings of the 35th Canadian Conference on Artificial Intelligence, Toronto, Ontario, 2022
When Chosen Wisely, More Data Is What You Need: A Universal Sample-Efficient Strategy For Data Augmentation.
Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022
2021
Generative locally linear embedding: A module for manifold unfolding and visualization.
Softw. Impacts, 2021
Computationally instrument-resolution-independent de novo peptide sequencing for high-resolution devices.
Nat. Mach. Intell., 2021
Fine-Tuning and training of densenet for histopathology image representation using TCGA diagnostic slides.
Medical Image Anal., 2021
A new approach to the numerical solution of Fredholm integral equations using least squares-support vector regression.
Math. Comput. Simul., 2021
Supervised discriminative dimensionality reduction by learning multiple transformation operators.
Expert Syst. Appl., 2021
CoRR, 2021
Sufficient Dimension Reduction for High-Dimensional Regression and Low-Dimensional Embedding: Tutorial and Survey.
CoRR, 2021
CoRR, 2021
KKT Conditions, First-Order and Second-Order Optimization, and Distributed Optimization: Tutorial and Survey.
CoRR, 2021
KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation.
CoRR, 2021
How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding.
CoRR, 2021
Uniform Manifold Approximation and Projection (UMAP) and its Variants: Tutorial and Survey.
CoRR, 2021
Johnson-Lindenstrauss Lemma, Linear and Nonlinear Random Projections, Random Fourier Features, and Random Kitchen Sinks: Tutorial and Survey.
CoRR, 2021
CoRR, 2021
Unified Framework for Spectral Dimensionality Reduction, Maximum Variance Unfolding, and Kernel Learning By Semidefinite Programming: Tutorial and Survey.
CoRR, 2021
Legendre Deep Neural Network (LDNN) and its application for approximation of nonlinear Volterra Fredholm Hammerstein integral equations.
CoRR, 2021
Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nyström Method, and Use of Kernels in Machine Learning: Tutorial and Survey.
CoRR, 2021
Laplacian-Based Dimensionality Reduction Including Spectral Clustering, Laplacian Eigenmap, Locality Preserving Projection, Graph Embedding, and Diffusion Map: Tutorial and Survey.
CoRR, 2021
Factor Analysis, Probabilistic Principal Component Analysis, Variational Inference, and Variational Autoencoder: Tutorial and Survey.
CoRR, 2021
Proceedings of the Medical Imaging with Deep Learning, 7-9 July 2021, Lübeck, Germany., 2021
Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation.
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021
How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021
Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021
Proceedings of the Seventh Workshop on Noisy User-generated Text, 2021
Not Far Away, Not So Close: Sample Efficient Nearest Neighbour Data Augmentation via MiniMax.
Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021
2020
Pattern Recognit., 2020
CoRR, 2020
Stochastic Neighbor Embedding with Gaussian and Student-t Distributions: Tutorial and Survey.
CoRR, 2020
CoRR, 2020
2019
Expert Syst. Appl., 2019
2018
SRP: Efficient class-aware embedding learning for large-scale data via supervised random projections.
CoRR, 2018
Localization and classification of cell nuclei in post-neoadjuvant breast cancer surgical specimen using fully convolutional networks.
Proceedings of the Medical Imaging 2018: Digital Pathology, 2018
Proceedings of the 2018 International Joint Conference on Neural Networks, 2018
Nonnegative Matrix Factorization Using Autoencoders And Exponentiated Gradient Descent.
Proceedings of the 2018 International Joint Conference on Neural Networks, 2018
Proceedings of the International Conference on Artificial Intelligence and Statistics, 2018
2017
Fast and Scalable Feature Selection for Gene Expression Data Using Hilbert-Schmidt Independence Criterion.
IEEE ACM Trans. Comput. Biol. Bioinform., 2017
Sparse supervised principal component analysis (SSPCA) for dimension reduction and variable selection.
Eng. Appl. Artif. Intell., 2017
CoRR, 2017
Synthesizing Deep Neural Network Architectures using Biological Synaptic Strength Distributions.
CoRR, 2017
Proceedings of the 2017 International Joint Conference on Neural Networks, 2017
Discovery Radiomics via a Mixture of Deep ConvNet Sequencers for Multi-parametric MRI Prostate Cancer Classification.
Proceedings of the Image Analysis and Recognition - 14th International Conference, 2017
Proceedings of the Image Analysis and Recognition - 14th International Conference, 2017
2016
Proceedings of the Image Analysis and Recognition - 13th International Conference, 2016
2015
Proceedings of the Thirty-First Conference on Uncertainty in Artificial Intelligence, 2015
A Dimension-Independent Generalization Bound for Kernel Supervised Principal Component Analysis.
Proceedings of the 1st Workshop on Feature Extraction: Modern Questions and Challenges, 2015
Proceedings of the 2015 International Joint Conference on Neural Networks, 2015
2014
IEEE ACM Trans. Audio Speech Lang. Process., 2014
Minimizing the Discrepancy Between Source and Target Domains by Learning Adapting Components.
J. Comput. Sci. Technol., 2014
2013
Knowl. Inf. Syst., 2013
Determining Protein Structures from NOESY Distance Constraints by Semidefinite Programming.
J. Comput. Biol., 2013
Proceedings of the 2013 IEEE 13th International Conference on Data Mining, 2013
2012
Dagstuhl Reports, 2012
Detecting Change-Points in Time Series by Maximum Mean Discrepancy of Ordinal Pattern Distributions.
Proceedings of the Twenty-Eighth Conference on Uncertainty in Artificial Intelligence, 2012
Proceedings of the Research in Computational Molecular Biology, 2012
Proceedings of the 12th IEEE International Conference on Data Mining, 2012
Proceedings of the 12th IEEE International Conference on Data Mining, 2012
Supervised Texture Classification Using a Novel Compression-Based Similarity Measure.
Proceedings of the Computer Vision and Graphics - International Conference, 2012
2011
Supervised principal component analysis: Visualization, classification and regression on subspaces and submanifolds.
Pattern Recognit., 2011
Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, 2011
Proceedings of the 2011 International Joint Conference on Neural Networks, 2011
Proceedings of the 2011 International Joint Conference on Neural Networks, 2011
Proceedings of the Image Analysis and Recognition - 8th International Conference, 2011
Proceedings of the 11th IEEE International Conference on Data Mining, 2011
2010
Proceedings of the Machine Learning and Knowledge Discovery in Databases, 2010
Proceedings of the 20th International Conference on Pattern Recognition, 2010
Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence, 2010
2009
2008
Proceedings of the International Symposium on Artificial Intelligence and Mathematics, 2008
Proceedings of the Machine Learning, 2008
Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence, 2008
2007
Proceedings of the IJCAI 2007, 2007
2006
Automatic dimensionality selection from the scree plot via the use of profile likelihood.
Comput. Stat. Data Anal., 2006
Fast Freenet: Improving Freenet Performance by Preferential Partition Routing and File Mesh Propagation.
Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2006), 2006
2005
Proceedings of the Robotics Research: Results of the 12th International Symposium, 2005
Proceedings of the IJCAI-05, Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, Edinburgh, Scotland, UK, July 30, 2005
Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), 2005
2004
Proceedings of the Computer Vision, 2004
2003
2002
Proceedings of the Advances in Neural Information Processing Systems 15 [Neural Information Processing Systems, 2002