Skip to content

Commit 33d3964

Browse files
committed
first commit
1 parent a221496 commit 33d3964

26 files changed

+16998
-1
lines changed

README.md

+17-1
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,18 @@
11
# python-web-scraping
2-
Hands-on workshop material on Web scraping using Python
2+
3+
Note : This repository is under construction 🛠️⚠️
4+
5+
Hands-on workshop material on Web scraping using Python.
6+
7+
### To build and run site locally :
8+
9+
1. git clone https://github.com/MonashDataFluency/python-web-scraping.git
10+
2. cd python-web-scraping
11+
3. virtualenv -p python3 venv
12+
4. source venv/bin/activate
13+
5. pip install -r requirements.txt
14+
6. mkdocs serve
15+
16+
Note : wptools might throw an error during installtion, in which case install other depencies as :
17+
- sudo apt install libcurl4-openssl-dev libssl-dev
18+
and then proceed to install wptools (via step 5 above)

data/fortune_500_companies.csv

+501
Large diffs are not rendered by default.

data/infoboxes.json

+1
Large diffs are not rendered by default.

data/top_20_companies.csv

+21
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
rank,company_name,company_website,wiki_title,product,industry,assets
2+
1,Walmart,http://www.stock.walmart.com,Walmart,electronics|movies and music|home and furniture|home improvement|clothing|footwear|jewelry|toys|health and beauty|pet supplies|sporting goods and fitness|auto|photo finishing|craft supplies|party supplies|grocery,retail,219.295 billion
3+
2,Exxon Mobil,http://www.exxonmobil.com,ExxonMobil,crude oil|oil products|natural gas|petrochemical|power generation,energy industry|energy|oil and gas industry|oil and gas,346.2 billion
4+
3,Berkshire Hathaway,http://www.berkshirehathaway.com,Berkshire Hathaway,investment|diversified investments|insurancetypes|property casualty insurance|public utility|utilities|restaurants|food processing|aerospace|toys|mass media|media|automotive industry|automotive|sports equipment|sporting goods|final good|consumer products|internet|real estate,conglomerate (company)|conglomerate,707.8 billion
5+
4,Apple,http://www.apple.com,Apple Inc.,macintosh|ipod|iphone|ipad|apple watch|apple tv|homepod|macos|ios|ipados|watchos|tvos|ilife|iwork|final cut pro|logic pro|garageband|shazam application|shazam|siri,computer hardware|computer software|consumer electronics|cloud computing|digital distribution|fabless manufacturing|fabless silicon design|semiconductors|financial technology|artificial intelligence,338.516 billion
6+
5,UnitedHealth Group,http://www.unitedhealthgroup.com,UnitedHealth Group,uniprise|health care|service economics|services|ingenix,managed health care,173.889 billion
7+
6,McKesson,http://www.mckesson.com,McKesson Corporation,pharmaceuticals|medical technology|health care services,healthcare,60.381 billion
8+
7,CVS Health,http://www.cvshealth.com,CVS Health,,retail|health care,196.456 billion
9+
8,Amazon.com,http://www.amazon.com,Amazon (company),amazon echo|amazon fire tablet|amazon fire|amazon fire tv|fire os|amazon fire os|amazon kindle,cloud computing|e-commerce|artificial intelligence|consumer electronics|digital distribution|grocery stores,162.648 billion
10+
9,AT&T,http://www.att.com,AT&T,satellite television|landline|fixed-line telephones|mobile phone|mobile telephones|internet service provider|internet services|broadband|digital television|home security|iptv|over-the-top media services|ott services|network security|filmmaking|film production|television production|cable television|pay television|publishing|podcast|sports management|news agency|video game,telecommunications industry|telecommunications|technology company|technology|mass media|entertainment,531.0 billion
11+
10,General Motors,http://www.gm.com,General Motors,car|automobiles|commercial vehicle,automotive industry|automotive,227.339 billion
12+
11,Ford Motor,http://www.corporate.ford.com,Ford Motor Company,car|automobiles|luxury car|luxury vehicles|commercial vehicle|commercial vehicles|list of auto parts|automotive parts|pickup trucks|suvs,automotive industry|automotive,256.54 billion
13+
12,AmerisourceBergen,http://www.amerisourcebergen.com,AmerisourceBergen,pharmaceutical|pharmacy,pharmaceutical,37.66 billion
14+
13,Chevron,http://www.chevron.com,Chevron Corporation,petroleum|natural gas|petrochemical|marketing brands|see chevron products,oil and gas industry|oil and gas,253.9 billion
15+
14,Cardinal Health,http://www.cardinalhealth.com,Cardinal Health,,pharmaceuticals,39.95 billion
16+
15,Costco,http://www.costco.com,Costco,,retail,45.4 billion
17+
16,Verizon,http://www.verizon.com,Verizon Communications,cable television|landline|mobile phone|broadband|digital television|iptv|digital media|internet of things|internet|telematics,telecommunications industry|telecommunications|mass media,264.82 billion
18+
17,Kroger,http://www.thekrogerco.com,Kroger,supercenter|superstore|supermarket,retail,38.11 billion
19+
18,General Electric,http://www.ge.com,General Electric,aircraft engine|electric power distribution|electrical distribution|electric motor|energy|finance|health care|lighting|software|wind turbine,conglomerate (company)|conglomerate,309.129 billion
20+
19,Walgreens Boots Alliance,http://www.walgreensbootsalliance.com,Walgreens Boots Alliance,drug store|pharmacy,pharmaceutical|retail,67.59 billion
21+
20,JPMorgan Chase,http://www.jpmorganchase.com,JPMorgan Chase,alternative financial service|american depositary receipt|asset allocation|asset management|bond finance|bond|broker|capital market|collateralized debt obligation|commercial banking|commodity market|commodities|commercial bank|credit card|credit default swap|credit derivative|currency exchange|custodian bank|debt settlement|digital banking|estate planning|exchange-traded fund|financial analysis|financial market|foreign exchange market|futures exchange|hedge fund|index fund|information processing|institutional investor|institutional investing|insurance|investment bank|financial capital|investment capital|investment management|portfolio finance|portfolios|loan servicing|merchant services|mobile banking|money market|mortgage brokers|mortgage broker|mortgage loan|mortgage-backed security|mortgagebacked securities|mutual fund|pension fund|prime brokerage|private banking|private equity|remittance|retail banking|broker|risk management|securities lending|security finance|security|stock trader|stock trading|subprime lending|treasury services|trustee|underwriting|venture capital|wealth management|wholesale funding|wholesale mortgage lenders|wholesale mortgage lending|wire transfer,bank|financial services,2.687 trillion

0 commit comments

Comments
 (0)