Category:Big Data

  • Introduction to Spark

    Time:2024-6-17

    1、Introduction to Spark 2、Spark-Core Core Arithmetic 3、Spark-Core 4、SparkSQL Article Catalog I. IntroductionII. Installation1. Introduction2、Local deployment (Local mode)2.1 Installation2.2 Official WordCount example 3. Standlong mode3.1 Introduction2.2 Installing the cluster2.3 Official Test Cases 4. Yarn model3.1 Installation3.2 Configuring the History Server3.3 Configuring to View Historical Logs 5. Mesos mode6. Comparison of several models7. Common ports Third, Yarn […]

  • kafka selection comparison and application scenarios

    Time:2023-11-29

    Article Series Catalog Getting Started first pass, hand to teach you to install kafka and visualization tools kafka-eagle What is Kafka and how to use SpringBoot to interface with Kafka Architecture Essential Capabilities – kafka Selection Comparison and Application Scenarios Article Series CatalogI. Kafka’s model and advantages1. Kafka model2. Kafka advantages Second, the difference between […]

  • ELK+Kafka+Beats implementation for log collection platforms

    Time:2023-11-6

    Large amounts of data can be searched and analyzed in a short period of time. More than just a full-text search engine, Elasticsearch provides distributed multi-user capabilities, real-time analytics, and the ability to process complex search statements, making it useful in a wide range of scenarios, such as enterprise search, logging, and event data analysis. […]