ON ONE APPROACH TO IMPLEMENTATION OF INFORMATION INFRASTRUCTURE FOR RENEWABLE INFORMATION SEARCH

Alexander Andreevich Shinkarev

Abstract


Major tasks in the field of information technology that business faces today one way or an-other relate to data processing and search for new information in it. The methods in use include sta-tistical methods, machine learning models, and simpler methods and models. However, all solutions aimed at information search require an information infrastructure that would meet the basic re-quirements for systems of this kind. The purpose of the study was to describe the main functional and technical requirements to modern systems implementing renewable information search. The au-thor meant to form fundamental architectural proposals for the design of the system as a whole and its key parts, as well as to identify the main components of the information system and approaches to solving key problems for solutions based on the message exchange mechanism. Materials and methods. The paper considers the modern statement of the problem of creating enterprise infor-mation systems for renewable information search. The author compares message brokers that are viewed as the most interesting in the framework of this statement. Results. The article substantiates the relevance of
the problem of creating information systems for renewable information search and formulates
the task to create a system of such kind. The author makes an overview of the architecture design of the solution at a high level of abstraction. The modular composition of the information system under consideration is discussed. Kafka is chosen and substantiated as the most suitable message broker. The nuances of technical solutions to eliminate duplicate records and filter the latest infor-mation search results are analyzed.


Keywords


enterprise information systems, renewable information search, message broker, data analysis, Kafka

References


Loginovsky O.V., Shestakov A.L., Shinkarev A.A. Supercomputing Technologies as Drive for Development of Enterprise Information Systems and Digital Economy. Supercomputing Fron-tiers and Innovations, 2020, vol. 7, no. 1, pp. 55–70. DOI: 10.14529/jsfi200103

Message Bus. Available at: https://www.enterpriseintegrationpatterns.com/patterns/messaging/ MessageBus.html (accessed 31.12.2020).

Kalske M., Mäkitalo N., Mikkonen T. Challenges When Moving from Monolith to Micro-service Architecture. Garrigós I., Wimmer M. (eds.) Current Trends in Web Engineering. ICWE 2017. Lecture Notes in Computer Science, vol 10544. Springer, Cham., 2018. DOI: 10.1007/978-3-319-74433-9_3

Namiot D., Sneps-Sneppe M. On micro-services architecture. International Journal of Open Information Technologies, 2014, vol. 2, no. 9.

Viggiato M., Terra R., Rocha H., Valente M., Figueiredo E. Microservices in practice: A survey study, 2018.

Microservices. Available at: https://martinfowler.com/articles/microservices.html (accessed 31.12.2020).

Message broker. Available at: https://en.wikipedia.org/wiki/Message_broker (accessed 31.12.2020).

Messaging that just works – RabbitMQ. Available at: https://www.rabbitmq.com (accessed 31.12.2020).

Apache Kafka. Available at: https://kafka.apache.org/ (accessed 31.12.2020).

RabbitMQ vs. Kafka. Available at: https://medium.com/better-programming/rabbitmq-vs-kafka-1ef22a041793 (accessed 31.12.2020).

Kafka Consumer. Available at: https://docs.confluent.io/platform/current/clients/consumer.html (accessed 31.12.2020).

SQL and NOSQL: Which is Better. Available at: http://www.jetir.org/papers/JETIR1508005.pdf (accessed 31.12.2020).

The Future is Polyglot Persistence. Available at: https://martinfowler.com/articles/nosql-intro-original.pdf (accessed 31.12.2020).

Merge (SQL). Available at: https://en.wikipedia.org/wiki/Merge_(SQL) (accessed 31.12.2020).

ACID. Available at: https://en.wikipedia.org/wiki/ACID (accessed 31.12.2020).




DOI: http://dx.doi.org/10.14529/ctcr210101

Refbacks

  • There are currently no refbacks.