Skip to main content

refactor

Oracle Autonomous Database​

Use always free plan. Most of the options can be configured easily via UI. But, I want to access DB via connection string so I configured network access differently.

Configure network access

I successfully created the database, and I'll use this for my application related to game.

When you want to connect with JDBC Thin connection, follow this link.

Oracle Object Storage​

Create bucket

Create bucket

Refactor the Python code

  • Use Polars to process the data
  • Use new python-oracledb Python package to connect Oracle Autonomous Database
  • Build Docker image to run as a Kubernetes job

데이터 포맷을 갈아엎으면서 로직을 개선하고, 스케줄링이 가능하도록 변경하였으며, 기존에는 2000개 데이터만 처리하던 것을 모든 유효한 데이터를 처리하도록 변경함