PhD Research
System Evolution Analytics: Data mining and learning of Complex and Big Evolving Systems
Project Members: Animesh Chaturvedi, Dr. Aruna Tiwari, Prof. Dave Binkley, Emeritus Prof. Nicolas Spyratos, and Prof. Pietro Lio'
Usually, real-world evolving systems have many entities (or components), which evolves over time. A technique can be used to analyze the evolving system; the technique is named as System Evolution Analytics. Such techniques can be applied on an evolving system represented as a set of temporal networks. These techniques fall in the categories of system learning and system mining. The state series of an evolving system is denoted as SS = {S1, S2, . . . , SN}. Then, the connections (or relationships) between entities of each state are pre-processed to make a temporal network, and this resulted in a series of evolving networks EN = {EN1, EN2, . . . , ENN}. These temporal networks can be merged to make an evolution representor, which is used with learning and mining techniques for system evolution analysis. This made us to analyze evolving inter-connected entities of a system state series. The system learning is performed by applying active learning and deep learning on the evolution representor. The system mining is performed by applying two proposed pattern-mining techniques: network rule mining and subgraph mining. Specifically, the publications describe the following proposed approaches: System State Complexity, Evolving System Complexity, System Evolution Recommender, Stable Network Evolution Rule, and System Changeability Metric. The proposed approaches are used to generate recommendation and evolution information to perform system evolution analysis. For example, a graph theory application of a service change classifier algorithm assigning change labels to a web service’s call graph representing calls between operations and procedures, which helped to do Web Service Slicing by extracting a WSDL slice for Inter-operational analysis.
Assuming some evolving systems change due to changing and evolving environment. We aim to introduce techniques that can be applied to discover hidden information about an evolving system. We are interested to develop algorithms and tools to mine and learn evolving system based on association rule mining, network motif mining, and deep learning. First, data mining technique like association rule mining identifies frequent patterns, associations, or correlations from evolving system. Second, network motifs are sub-graphs, which reoccur in a network by a particular pattern of interactions in an evolving system. Third, deep Learning is inspired from structure and function of the neural network in human brain. Deep learning forms Deep Neural Network (DNN), which is a kind of well-known Artificial Neural Networks (ANN). Fourth, efficient service evolution analytics using change/evolution mining based on change classification and evolution metrics. Fifth, Big Scholarly data analytics for the publication titles of 217 years in all research fields using parallel frequent pattern-growth algorithms for rules generation.
Our data mining and machine learning techniques can identify hidden information about an evolving system. Such information is further helpful in decision-making. Our work aims to reduce human effort with the help of recommender/mining/learning tools construction. Evolving systems, Number of states used for the experiments, and their Internet links.
GitHub Repositories for
Stable Network Evolution Rule Mining: https://github.com/animesh88/StableNetworkEvolutionRuleMining
There are five more such projects, once they are completed. I will upload them.
Datasets
Hadoop HDFS-Core, 15 Versions used, https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-hdfs
Bible Translation, 13 Centuries data was used, https://en.wikipedia.org/wiki/List_of_English_Bible_translations
Multi-sport Events, 13 Decades data was used, https://en.wikipedia.org/wiki/List_of_multi-sport_events
Retail market system, 13 Months data was used, https://archive.ics.uci.edu/ml/datasets/Online+Retail
Positive sentiment of movie genres, 16 Decades data was used, http://www.imdb.com/interfaces/ using the sentiment list of https://www.cs.uic.edu/~liub/FBS/sentiment-analysis.html
Negative sentiment of movie genres, 16 Decades data was used, http://www.imdb.com/interfaces/ using the sentiment list of https://www.cs.uic.edu/~liub/FBS/sentiment-analysis.html
Journals
Animesh Chaturvedi, Aruna Tiwari, Shubhangi Chaturvedi, and Pietro Lio'. "System Neural Network: Evolution and Change based Structure Learning", IEEE Transactions on Artificial Intelligence. Vol. 3.3, pp. 426 - 435, June 2022. DOI: 10.1109/TAI.2022.3143778. (IEEE Computer Society and IEEE Computational Intelligence Society)
Animesh Chaturvedi, Aruna Tiwari, Shubhangi Chaturvedi, and David Binkley. “Service Evolution Analytics: Change and Evolution Mining of a Distributed System”, IEEE Transactions on Engineering Management, Vol. 68.1, pp. 137 - 148, Feb-2021, DOI: 10.1109/TEM.2020.2987641. (Technology and Engineering Management Society of IEEE, ABDC A) IF: 6.15
Animesh Chaturvedi, Aruna Tiwari, and Shubhangi Chaturvedi. “SysEvoRecomd: Network Reconstruction by Graph Evolution and Change Learning”, IEEE Systems Journal, Vol. 14.3, pp. 4007 - 4014, Sept. 2020. DOI: 10.1109/JSYST.2020.2988037. (IEEE Systems Council) IF: 4.463
Animesh Chaturvedi, Aruna Tiwari, and Nicolas Spyratos. “minStab: Stable Network Evolution Rule Mining for System Changeability Analysis”. IEEE Transactions on Emerging Topics in Computation Intelligence, Vol 5.2 (April 2019). DOI: 10.1109/TETCI.2019.2892734. (IEEE Computer Society and IEEE Computational Intelligence Society) IF: 4.34 PDF
Animesh Chaturvedi and Aruna Tiwari. "System Network Complexity: Network Evolution Subgraphs of System State Series." IEEE Transactions on Emerging Topics in Computational Intelligence, Vol 4.2 (2018): 130-139. DOI: 10.1109/TETCI.2018.2848293. (IEEE Computer Society and IEEE Computational Intelligence Society) IF: 4.34
Animesh Chaturvedi and David Binkley. "Web Service Slicing: Intra and Inter-Operational Analysis to Test Changes." IEEE Transactions on Services Computing, Vol 14.3: 930 - 943 (2018). DOI: 10.1109/TSC.2018.2821157 (IEEE Computer Society, Core A*) IF: 8.22
IEEE TSC belongs to the elite family of IEEE Transactions published by IEEE Computer Society.
IEEE TAI and IEEE TETCI and belongs to elite family of IEEE Transaction published by IEEE Computational Intelligence Society and IEEE Computer Society.
IEEE TEM and IEEE SJ are one of the oldest journals in Engineering, Systems, and Management published by IEEE Systems Council and IEEE Technology and Engineering Management Society.
Conferences
Animesh Chaturvedi, Aruna Tiwari, and Nicolas Spyratos. “System Network Analytics: Evolution and Stable Rules of a State Series”. IEEE 9th International Conference on Data Science and Advanced Analytics (DSAA), October 13-16, 2022, Shenzhen, China. IEEE, 2022. (Core A)
Animesh Chaturvedi, and Rajesh Sharma. “minOffense: Inter-Agreement Hate Terms for Stable Rules, Concepts, Transitivities, and Lattices”. IEEE 9th International Conference on Data Science and Advanced Analytics (DSAA), October 13-16, 2022, Shenzhen, China. IEEE, 2022. (Core A)
Animesh Chaturvedi. 2022. Call Graph Evolution Analytics over a Version Series of an Evolving Software System. In 37th IEEE/ACM International Conference on Automated Software Engineering (ASE ’22), October 10–14, 2022, Rochester, MI, USA. ACM, New York, NY, USA, 5 pages. (Core A*)
Animesh Chaturvedi and Aruna Tiwari. "SysEvoRecomd: Graph Evolution and Change Learning Based System Evolution Recommender". In 2018 IEEE International Conference on Data Mining Workshops (ICDMW) (pp. 1499-1500). IEEE.
Animesh Chaturvedi and Aruna Tiwari. "System Evolution Analytics: Evolution and Change Pattern Mining of Inter-Connected Entities". In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 3075-3080 ). IEEE. PDF
Animesh Chaturvedi and Aruna Tiwari. "System Evolution Analytics: Deep Evolution and Change Learning of Inter-Connected Entities". In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 3877-3882). IEEE. PDF
System Network Analysis of an Evolving System, which provides summarized report (like time series, recommendations, rules etc.) to help in decision-making and action-taking task .
Common Flow-Chart of all the approach system state series SS = {S1, S2...SN} to make set of evolving networks {EN1, EN2... ENN} , which produces mining and learning information that we aggregated to retrieve evolution information.