Skip to main content

baming
Pace non trovo

Hallo. 안녕하세요! 정승혜 입니다. 개발 일지 뿐만 아니라 나의 관심 있는 모든 것을 담을거예요.

/notes
About
Tags
Categories
Archive

    Organized by Category

    Basic

  • Airflow and DataFrame
  • Make Dags, python venv
  • Web crawling - Chrome Driver
  • Airflow-WebCrawling

    • Post

  • CoCoaPods
  • Deploy Status
  • APP Develop - IoT Sensor
  • 6 Ways to Achieve New Things
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Workflow
  • Scala version
  • Kafka Spark 연동 가이드
  • Workflow
  • The long adventure to success Pipeline...4) going to be crazy. Spakr is already exsist on Docker!
  • The long adventure to success Pipeline...4
  • The long adventure to success Pipeline...3) Do I need 'hostaliases' for connected Public?
  • The long adventure to success Pipeline...2) Rebuild
  • The long adventure to designing Pipeline...1) Edit & Analyst DataProccess Source
  • Spark, Kafka, Airflow Resources
  • Kafka,Spark Containers are linked. Test Origin code of 'data proccess'
  • This is whole steps rebuilding code of Data Proccessing
  • Install Spark in Local
  • What is Spark?
  • Airflow's Permission
  • Make CustomResources for Airflow Image
  • Ingress, customValues, mount etc.
  • Approve Dag files (add Schedule interval)
  • Add Helm Repository Airflow
  • Test networking between each Container
  • Connected Airflow with Kafka (v.Docker)
  • Install Kafka&Airflow by Docker
  • Install Kafka and Use Funcitons
  • Kafka Message Check
  • Airflow and DataFrame
  • Make Dags, python venv
  • Web crawling - Chrome Driver
  • Airflow-WebCrawling

    • Startups

  • Approve Dag files (add Schedule interval)
  • Test networking between each Container
  • Connected Airflow with Kafka (v.Docker)
  • Install Kafka&Airflow by Docker
  • Install Kafka and Use Funcitons
  • Kafka Message Check

    • Selfimprovement

  • Airflow's Permission
  • Make CustomResources for Airflow Image
  • Ingress, customValues, mount etc.
  • Add Helm Repository Airflow

    • Build

  • This is whole steps rebuilding code of Data Proccessing
  • Install Spark in Local
  • What is Spark?

    • Build

  • The long adventure to success Pipeline...4) going to be crazy. Spakr is already exsist on Docker!
  • The long adventure to success Pipeline...4
  • The long adventure to success Pipeline...3) Do I need 'hostaliases' for connected Public?
  • The long adventure to success Pipeline...2) Rebuild
  • The long adventure to designing Pipeline...1) Edit & Analyst DataProccess Source
  • Spark, Kafka, Airflow Resources
  • Kafka,Spark Containers are linked. Test Origin code of 'data proccess'

    • Development

  • CoCoaPods
  • Deploy Status
  • APP Develop - IoT Sensor