Mohammad Mohammadi Amiri
Dr. Amiri was appointed an Assistant Professor in the Department of Computer Science at RPI in Fall 2023.
His research is mainly dedicated to advancing artificial intelligence through the strategic use of data.
In today's rapidly evolving technological landscape, the ability to harness and optimize data is key to unlocking the full potential of intelligent systems.
Dr. Amiri's research focuses on leveraging data to enhance artificial intelligence's capabilities, aiming to create systems that benefit everyone
His primary research interests include large language models, data valuation, federated learning, and deep learning.
Dr. Amiri received the Ph.D. degree in Electrical and Electronic Engineering form Imperial College London in 2019.
He further received the M.Sc. degree in Electrical and Computer Engineering from the University of Tehran in 2014, and the B.Sc. degree in Electrical Engineering from the Iran University of Science and Technology in 2011, both with the highest rank.
He is the recipient of the Best Ph.D. Thesis award from both the Department of Electrical and Electronic Engineering at Imperial College London during the academic year 2018-2019, as well as the IEEE Information Theory Chapter of UK and Ireland in the year 2019.
Also, his paper titled "Federated learning over wireless fading channels" received the IEEE Communications Society Young Author Best Paper Award in the year 2022.
For motivated Ph.D. students with strong mathematical and analytical skills: Please send your CV to the above email address if you are interested in Machine Learning and comfortable with programming.
- Large language models (LLMs)
In the era of artificial intelligence (AI) and natural language processing, large language models (LLMs) have become transformative tools, reshaping how we interact with and extract insights from vast amounts of textual data.
These models, with their immense scale and capabilities, are central to a wide range of applications, from chatbots and virtual assistants to content generation, translation, and information retrieval.
However, the effective deployment of LLMs presents significant challenges, particularly in terms of efficiency, memory usage, alignment, data management, and reasoning.
Our research group focuses on optimizing the resource-intensive process of fine-tuning LLMs to enhance efficiency in terms of time, energy, and computational resources.
We are also addressing the challenge of memory efficiency during LLM inference, ensuring these models can be deployed effectively even in resource-constrained environments.
Moreover, we are dedicated to the critical task of LLM alignment, both through theoretical analysis and empirical studies, to ensure that these models behave in ways that are consistent with intended goals and ethical standards.
Our research also includes data valuation methods to prioritize high-quality data in LLM training and investigates how LLMs can be utilized to evaluate and enhance the quality of data, creating a feedback loop that benefits both the models and the data they rely on.
Additionally, we work on improving the reasoning capabilities of LLMs to ensure they generate complex, contextually accurate responses.
- Data valuation
Data is the main fuel of the modern world enabling AI and driving technological growth.
The demand for data has grown substantially, and data products have become valuable assets to purchase and sale since it is extremely valuable for sectors to acquire high quality data to discover knowledge.
As a valuable resource, it is important to establish a principled method to quantify the worth of the data and its value for the data seekers.
This is addressed via data valuation which is the essential component for realization of a fair data trading platform for owners and seekers.
- Federated learning/Privacy-preserving machine learning
Today a tremendous amount of data is being generated at different network layers that can be utilized to improve the intelligence of many applications.
Privacy-preserving machine learning techniques, such as federated learning, have emerged to exploit the decentralized data while the data stays local to the owner’s device.
Specifically, federated learning aims to fit a global model to the decentralized data available locally at the edge devices.
The devices receive the global model from the server, update it using their local data, and share the local updates with the server.
The server aggregates the local updates, where a common aggregation rule is averaging the local updates, and updates the global model.
Besides its applicability, this algorithm imposes various challenges inclduing participaton incentivization, privacy concerns, heterogenous data distribution, model heterogeneity, communication overhead, etc.
- Deep learning
The theory of deep learning involves a comprehensive study of the fundamental principles and mathematical foundations that underlie neural networks.
This includes understanding the intricacies of network architectures, optimization algorithms, regularization techniques, generalization properties, and how these components contribute to the learning process within deep learning models.
The goal is to elucidate the theoretical aspects to improve model interpretability, robustness, and overall performance, advancing the field and its applications.
- Book chapters
- M. Mohammadi Amiri and D. Gunduz, Machine learning and wireless communications, (edited by H. Vincent Poor, Yonina Eldar, Andrea Goldsmith, and Deniz Gunduz), Cambridge University Press, Cambridge, UK, 2021.
- M. Mohammadi Amiri and D. Gunduz, Edge caching for mobile networks, (edited by H. Vincent Poor and Wei Chen), IET Press, London, UK, 2021.
- Conference proceedings
- A. Falahati and M. Mohammadi Amiri, Disentangled structural and featural representation for task-agnostic graph valuation, under review.
- C. Lu, M. Mohammadi Amiri, and R. Raskar, Data measurements for decentralized data markets, under review.
- P. Vapakomma, M. Mohammadi Amiri, C. L. Canonne, R. Raskar, and A. Pentland, Private independence testing across two parties, under review.
- Z. Wu, M. Mohammadi Amiri, R. Raskar, and B. K. H. Low, Incentive-aware federated learning with training-time model rewards, International Conference on Learning Representations (ICLR), Vienna, Austria, May 2024.
- A. Chopra, S. K. Sahu, A. Singh, A. Java, P. Vepakomma, M. Mohammadi Amiri, and R. Raskar, Adaptive split learning, Conference on Machine Learning and Systems (MLSys), Miami Beach, FL, USA, Jun. 2023.
- K. Yang*, M. Mohammadi Amiri*, and S. Kulkarni, Greedy centroid initialization for federated K-means, Conference on Information Sciences and Systems, Baltimore, MD, USA, Mar. 2023.
* Equal contribution.
- M. Mohammadi Amiri, F. Berdoz, and R. Raskar, Fundamentals of task-agnostic data valuation, AAAI Conference on Artificial Intelligence, Washington DC, USA, Feb. 2023.
- M. Mohammadi Amiri, S. R. Kulkarni, and H. V. Poor, Federated learning with downlink device selection, IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), Lucca, Italy, Sep. 2021.
- M. Mohammadi Amiri, D. Gunduz, S. R. Kulkarni, and H. V. Poor, Federated learning with quantized global model updates, Jun. 2020.
- M. Mohammadi Amiri, D. Gunduz, S. R. Kulkarni, and H. V. Poor, Update aware device scheduling for federated learning at the wireless edge, IEEE International Symposium on Information Theory (ISIT), Los Angeles, CA, USA, Jun. 2020.
- M. Mohammadi Amiri, T. M. Duman, and D. Gunduz, Collaborative machine learning at the wireless edge with blind transmitters, IEEE Global Conference on Signal and Information Processing (GlobalSIP), Ottawa, Canada, Nov. 2019.
- M. Mohammadi Amiri and D. Gunduz, Machine learning at the wireless edge: distributed stochastic gradient descent over-the-air, IEEE International Symposium on Information Theory (ISIT), Paris, France, Jul. 2019.
- M. Mohammadi Amiri and D. Gunduz, Over-the-air machine learning at the wireless edge, IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), Cannes, France, Jul. 2019.
- J. Zhao, M. Mohammadi Amiri, and D. Gunduz, A low-complexity cache-aided multi-antenna content delivery scheme, IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), Cannes, France, Jul. 2019.
- M. Mohammadi Amiri and D. Gunduz, Computation scheduling for distributed machine learning with straggling workers, IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Brighton, UK, 2019.
- M. Mohammadi Amiri and D. Gunduz, On the capacity region of a cache-aided Gaussian broadcast channel with multi-layer messages, IEEE International Symposium on Information Theory (ISIT), Colorado, USA, Jun. 2018.
- M. Mohammadi Amiri and D. Gunduz, Decentralized caching and coded delivery over Gaussian broadcast channels, IEEE International Symposium on Information Theory (ISIT), Aachen, Germany, Jun. 2017.
- Q. Yang, M. Mohammadi Amiri, and D. Gunduz, Audience retention rate aware coded video caching, IEEE International Conference on Communications (ICC), Paris, France, May 2017.
- M. Mohammadi Amiri and D. Gunduz, Cache-aided data delivery over erasure broadcast channels, IEEE International Conference on Communications (ICC), Paris, France, May 2017.
- M. Mohammadi Amiri, Q. Yang, and D. Gunduz, Decentralized coded caching with distinct cache capacities, Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, Nov. 2016.
- M. Mohammadi Amiri and D. Gunduz, Improved delivery rate-cache capacity trade-off for centralized coded caching, IEEE International Symposium on Information Theory and Its Applications (ISITA), Monterey, CA, Oct.-Nov. 2016.
- M. Mohammadi Amiri, Q. Yang, and D. Gunduz, Coded caching for a large number of users, IEEE Information Theory Workshop (ITW), Cambridge, UK, pp. 171-175, Sep. 2016.
- M. Mohammadi Amiri and A. Olfat, Low complexity adaptive transmission scheme for cooperative networks with decode-and-forward relay, International Symposium on Telecommunications (IST), Tehran, Iran, pp. 1128-1132, Sep. 2014.
- Journal papers
- K. Yang*, M. Mohammadi Amiri*, and S. Kulkarni, Greedy centroid initialization for federated K-means, Knowledge and Information Systems, vol. 66, pp. 3393-3425, Feb. 2024.
*Equal contribution
- Y.-S. Jeon, M. Mohammadi Amiri, and N. Lee, Communication-efficient federated learning over MIMO multiple access channels, IEEE Transactions on Communications, vol. 70, no. 10, pp. 6547-6562, Oct. 2022.
- H. Hellstrom, J. M. da Silva, M. Mohammadi Amiri, M. Chen, V. Fodor, H. V. Poor, and C. Fischione, Wireless for machine learning: a survey, Foundations and Trends in Signal Processing, vol. 15, no. 4, pp. 290-399, Jun. 2022.
- M. Mohammadi Amiri, D. Gunduz, S. R. Kulkarni, and H. V. Poor, Convergence of federated learning over a noisy downlink, IEEE Transactions on Wireless Communications, vol. 21, no. 3, pp. 1422-1437, Mar. 2022.
- M. Mohammadi Amiri, T. M. Duman, D. Gunduz, S. R. Kulkarni, and H. V. Poor, Blind federated edge learning, IEEE Transactions on Wireless Communications, vol. 20, no. 8, pp. 5129-5143, Aug. 2021.
- M. Mohammadi Amiri, D. Gunduz, S. R. Kulkarni, and H. V. Poor, Convergence of update aware device scheduling for federated learning at the wireless edge, IEEE Transactions on Wireless Communications, vol. 20, no. 6, pp. 3643-3658, Jun. 2021.
- Y.-S. Jeon, M. Mohammadi Amiri, J. Li, and H. V. Poor, A compressive sensing approach for federated learning over massive MIMO communication systems, IEEE Transactions on Wireless Communications, vol. 20, no. 3, pp. 1990-2004, Mar. 2021.
- D. Gunduz, D. Burth Kurka, M. Jankowski, M. Mohammadi Amiri, E. Ozfatura, and S. Sreekumar, Communicate to learn at the edge, IEEE Communication Magazine, vol. 58, no. 12, pp. 14-19, Dec. 2020.
- J. Zhao, M. Mohammadi Amiri, and D. Gunduz, Multi-antenna coded content delivery with caching: a low-complexity solution, IEEE Transactions on Wireless Communications, vol. 19, no. 11, pp. 7484-7497, Nov. 2020.
- M. Mohammadi Amiri and D. Gunduz, Federated learning over wireless fading channels, IEEE Transactions on Wireless Communications, vol. 19, no. 5, pp. 3546-3557, May 2020 (IEEE Communications Society Young Author Best Paper Award).
- M. Mohammadi Amiri and D. Gunduz, Machine learning at the wireless edge: distributed stochastic gradient descent over-the-air, IEEE Transactions on Signal Processing, vol. 68, pp. 2155-2169, Apr. 2020.
- M. Mohammadi Amiri and D. Gunduz, Computation scheduling for distributed machine learning with straggling workers, IEEE Transactions on Signal Processing, vol. 67, no. 24, pp. 6270-6284, Dec. 2019.
- Q. Yang, M. Mohammadi Amiri, and D. Gunduz, Audience-retention-rate-aware caching and coded video delivery with asynchronous demands, IEEE Transactions on Communications, vol. 67, no. 10, pp. 7088-7102, Oct. 2019.
- M. Mohammadi Amiri and D. Gunduz, Caching and coded delivery over Gaussian broadcast channels for energy efficiency, IEEE Journal on Selected Areas in Communications, vol. 36, no. 8, pp. 1706-1720, Aug. 2018.
- M. Mohammadi Amiri and D. Gunduz, Cache-aided content delivery over erasure broadcast channels, IEEE Transactions on Communications, vol. 66, no. 1, pp. 370-381, Jan. 2018.
- M. Mohammadi Amiri, Q. Yang, and D. Gunduz, Decentralized caching and coded delivery with distinct cache capacities, IEEE Transactions on Communications, vol. 65, no. 11, pp. 4657-4669, Nov. 2017.
- M. Mohammadi Amiri and B. Maham, Two novel adaptive transmission schemes in a decode-and-forward relaying network, Wireless Personal Communications, vol. 96, no. 4, pp. 5705-5722, Oct. 2017.
- M. Mohammadi Amiri and D. Gunduz, Fundamental limits of coded caching: Improved delivery rate-cache capacity trade-off, IEEE Transactions on Communications, vol. 65, no. 2, pp. 806-815, Feb. 2017.
- M. Mohammadi Amiri, A. Olfat, and N. C. Beaulieu, Novel beamforming scheme for multicasting in cooperative wireless networks with a multiple antenna relay, IEEE Transactions on Wireless Communications, vol. 14, no. 8, pp. 4482-4493, Aug. 2015.
Awards
- IEEE Communications Society Young Author Best Paper Award (2022),
paper "Federated learning over wireless fading channels", IEEE Transactions on Wireless Communications, vol. 19, no. 5, pp. 3546-3557, May 2020.
- Best PhD Thesis (2019), IEEE Information Theory Chapter of UK and Ireland.
- Eryl Cadwallader Davies Prize - Outstanding PhD Thesis (2019), EEE Department, Imperial College London.
- EEE Departmental Scholarship (2015 - 2019), Imperial College London.
- Excellent Student (2014), Ranked 1st among all M.Sc. students in ECE Department, University of Tehran.
- Excellent Student (2011), Ranked 1st among all B.Sc. students in EE Department, Iran University of Science and Technology.
Invited Talks
- Collective intelligence, Bell Labs, May 2023.
- Decentralized data valuation, Decentralized Society + Web3 Research Panel, Media Lab Fall Meeting, Massachusetts Institute of Technology, Oct. 2022.
- Federated edge machine learning, Keynote speaker at Futurewei University Days Workshop, Aug. 2021.
- Federated edge learning: advances and challenges, Keynote speaker at IEEE International Conference on Communications, Networks and Satellite (COMNETSAT), Dec. 2020.
- Federated edge learning: advances and challenges, King's College London, Nov. 2020.
- Federated edge learning: advances and challenges, University of Maryland, Oct. 2020.
- Federated edge learning: advances and challenges, University of Arizona, Oct. 2020.
- Federated learning: advances and challenges, Virginia Polytechnic Institute and State University (Virginia Tech), Oct. 2020.
- Fundamental limits of coded caching, Ohio State University, Nov. 2016.
- Fundamental limits of coded caching, Stanford University, Nov. 2016.
Academic Services
- Technical program committee
- IEEE International Conference on Distributed Computing Systems, 2024.
- IEEE Global Communications Conference (Globecom), Wireless Communications for Distributed Intelligence (WCDI), 2023.
- IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), 2022.
- IEEE International Conference on Microwaves, Communications, Antennas Electronic Systems, 2021.
- IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), 2021.
- IEEE International Conference on Communications (ICC) Workshop - Edge Learning for 5G Mobile Networks and Beyond (EdgeLearn5G), 2021.
- IEEE International Conference on Communications (ICC): SAC Machine Learning for Communications Track, 2021.
- IEEE International Conference on Communications, Networks and Satellite (COMNETSAT), 2020.
- IEEE Global Communications Conference (Globecom), Cognitive Radio and AI-Enabled Networks (CRAEN), 2020.
- Conference on Information Sciences and Systems (CISS), 2020.
- IEEE International Conference on Communications (ICC) Workshop - Edge Machine Learning for 5G Mobile Networks and Beyond (EML5G), 2020.
Openings
I am looking for motivated Ph.D. students with strong mathematical and analytical skills. Please send me your CV if you are interested in Machine Learning and comfortable with programming.
|