Python script to scrape Item descriptions and prices from NewEgg portal and then injecting info on Cloud Data Base
Description
This is the first source of information for our Data Pipeline Project. Through the use of multiple Python libraries, we are scrapping data from NewEgg portal, structuring the information and then automatically loading it on our Cloud Data Base Instance of Big Query (GCP)
Child issues
XDP-7
Code the script
Done
XDP-8
Test the result by sending resultant data frame to Google Sheets
Done
XDP-9
Create instance on GCP - Big Query
Done
XDP-10
Send all data Frames to cloud DB instance (Big Query)
In Progress
Activity
Show:
Details
Priority
MediumMore fields
Created: 30 May 2022, 23:04
Updated:
31 May 2022, 17:14
Still need to optimize Data Frames