ds-hack

Last updated Nov 23, 2022

• All post

• save tabular files to parquet format youtube
• change string column to category
• downcasting integers
  • int8 range : -128 to 127
  • int16 range: -32678 to 32676
• downcasting float to float32 (check some values behind decimals)
• change yes no column to boolean
• speed up pandas df looping -> apply() -> vectorized