Imposterò un moderno stack di dati sfruttando dbt, metabase, postgresql e airbyte

Alcune informazioni sono state tradotte automaticamente.
4,3
4,3

Kenya

Parlo Inglese

56 ordini completati

Sviluppare pipeline di dati e AI resilienti, affidabili e robuste

Mi specializzo nel trasformare dati aziendali disordinati in pipeline affidabili, magazzini cloud, dataset pronti per l'analisi e sistemi di dati pronti per ML. Aiuto startup e aziende in crescita a ...
Informazioni su questo servizio

Immagina le seguenti situazioni:

  • Una società matura con poca o nessuna infrastruttura digitale che consolida e trasforma automaticamente i dati, senza competenze per implementarla o gestirla
  • Una startup che vuole sfruttare i propri dati esistenti ma con un budget limitato per farlo con soluzioni commerciali
  • Una giornata piovosa con poco o niente da fare, se non imparare come costruire una data stack autonoma


Propongo di sfruttare diverse soluzioni open-source che, combinate, possono creare una data stack che soddisfa i requisiti minimi:

  • Orchestrazione dei task - Airflow
  • Integrazione dei dati - Airbyte
  • Data warehousing - PostgreSQL
  • Trasformazione dei dati - DBT


Può essere avviata localmente o da remoto, purché l'istanza soddisfi i seguenti requisiti:

Core: 2

RAM: 4GB (RAM minimo raccomandato per l'ultima versione di Airflow)

Memoria: almeno 12GB (senza considerare i dati scaricati con Airbyte)

Docker (https://docs.docker.com/engine/install/ubuntu/) e Docker Compose (https://docs.docker.com/compose/install/) installati

Python: (escludendo 3.9, per compatibilità con DBT)

Ubuntu: >=18.04

Il resto del processo di installazione si svolge in un terminale locale o in un Webserver

Expertise:

Estrazione dati

Manipolazione dati

Convalida dati

etl

Tecnologia:

Amazon Redshift

BigQuery

Python

SQL

NoSQL

Il mio portfolio

Altri servizi della categoria Data engineer offerti da me

Recensioni

6 recensioni per questo servizio
4,3

(3)
(2)
(1)
(0)
(0)
Valutazione dettagliata
  • Livello di comunicazione del venditore
    4,5
  • Qualità della consegna
    3,7
  • Valore della consegna
    4
Ordina per
Più rilevante
  • C
    image-docs

    cemkocabasa

    TR

    Turchia

    3

    I have what I wanted to have. But the level of involvement I imagined was far less. I had to send the same Json file 3-4 times for him to see it. Also he was hesitant to troubleshoot saying it wasn't part of the agreement. Which imo doesn't make sense because I was asking him to troubleshoot so I can...

    100 USD-200 USD

    $

    3 settimane

    Tempo

    Utile?
    No
  • S

    shane_provost

    US

    Stati Uniti

    4

    Quality of work was very good, and the documentation was pretty comprehensive. What was delivered was what I needed and will add a ton of value to my service!

    100 USD-200 USD

    $

    10 giorni

    Tempo

    Utile?
    No
  • B
    image-docs

    brandonsings

    US

    Stati Uniti

    4,7

    A really knowledgable and responsive seller who went above and beyond my expectations. Not only did he deliver quickly, he also helped teach me a few things along the way. Thanks so much!

    200 USD-400 USD

    $

    2 settimane

    Tempo

    Utile?
    No
  • L

    lonzin3

    GB

    Regno Unito

    5

    Wow, what an incredible experience working with Grivine! I was in a tough spot with my company's data, and they came to the rescue. He successfully set up data integration using Airbyte for us, and it has been a game-changer. Our data flows seamlessly, and we're finally making informed decisions.

    Fino a 50 USD

    $

    2 giorni

    Tempo

    Utile?
    No
  • L

    local_toast

    DE

    Germania

    4,3

    Getting an ELT stack up and running required far more work and effort from my side than expected, but Grivine did everything he could to help at every hurdle. I now have a repeatable deployment process, which is exactly what I wanted. Thanks! 👍

    100 USD-200 USD

    $

    7 giorni

    Tempo

    Utile?
    No
Recensioni

6 recensioni per questo servizio
4,3

(3)
(2)
(1)
(0)
(0)
Valutazione dettagliata
  • Livello di comunicazione del venditore
    4,5
  • Qualità della consegna
    3,7
  • Valore della consegna
    4
Ordina per
Più rilevante
  • C
    image-docs

    cemkocabasa

    TR

    Turchia

    3

    I have what I wanted to have. But the level of involvement I imagined was far less. I had to send the same Json file 3-4 times for him to see it. Also he was hesitant to troubleshoot saying it wasn't part of the agreement. Which imo doesn't make sense because I was asking him to troubleshoot so I can...

    100 USD-200 USD

    $

    3 settimane

    Tempo

    Utile?
    No
  • S

    shane_provost

    US

    Stati Uniti

    4

    Quality of work was very good, and the documentation was pretty comprehensive. What was delivered was what I needed and will add a ton of value to my service!

    100 USD-200 USD

    $

    10 giorni

    Tempo

    Utile?
    No
  • B
    image-docs

    brandonsings

    US

    Stati Uniti

    4,7

    A really knowledgable and responsive seller who went above and beyond my expectations. Not only did he deliver quickly, he also helped teach me a few things along the way. Thanks so much!

    200 USD-400 USD

    $

    2 settimane

    Tempo

    Utile?
    No
  • L

    lonzin3

    GB

    Regno Unito

    5

    Wow, what an incredible experience working with Grivine! I was in a tough spot with my company's data, and they came to the rescue. He successfully set up data integration using Airbyte for us, and it has been a game-changer. Our data flows seamlessly, and we're finally making informed decisions.

    Fino a 50 USD

    $

    2 giorni

    Tempo

    Utile?
    No
  • L

    local_toast

    DE

    Germania

    4,3

    Getting an ELT stack up and running required far more work and effort from my side than expected, but Grivine did everything he could to help at every hurdle. I now have a repeatable deployment process, which is exactly what I wanted. Thanks! 👍

    100 USD-200 USD

    $

    7 giorni

    Tempo

    Utile?
    No