Merge pull request #277 from anut123/master

E-Commerce Website

Author: powerexploit

Web-Scraping/E-Commerce Website/README.md

@@ -0,0 +1,9 @@
+# WebScrap
+
+Web scraping (web harvesting or web data extraction) is data scraping used for extracting data from websites. Web scraping software may access the World Wide Web directly using the Hypertext Transfer Protocol, or through a web browser.
+
+In this repo Web Scraping is done on an E-Commerce Website using BeautifulSoup in [Python](https://www.python.org/)
+
+[Beautiful Soup](https://www.crummy.com/software/BeautifulSoup/bs4/doc/)
+* Beautiful Soup is a Python library for pulling data out of HTML and XML files. It works with your favorite parser to provide idiomatic ways of navigating, searching, and modifying the parse tree. It commonly saves programmers hours or days of work.
+

Web-Scraping/E-Commerce Website/WebScraping.py

@@ -0,0 +1,42 @@
+import bs4
+from urllib.request import urlopen
+from bs4 import BeautifulSoup as soup
+
+my_url = 'https://www.newegg.com/Video-Cards-Video-Devices/Category/ID-38?Tpk=graphics%20card'
+
+# opening url and grabbing the web page
+uClient = urlopen(my_url)
+page_html = uClient.read()
+uClient.close()
+
+# html parsing
+page_soup = soup(page_html, 'html.parser')
+
+# grabbing all containers with class name = item-container
+containers = page_soup.findAll('div', {'class':'item-container'})
+
+filename = "products.csv"
+f = open(filename, 'w')
+
+headers = "brands, product_name, shipping\n"
+
+f.write(headers)
+
+container = containers[1]
+
+for container in containers:
+    brand = container.div.div.a.img['title']
+    title_container = container.findAll('a', {'class':'item-title'})
+    product_name = title_container[0].text
+    ship_container = container.findAll('li', {'class':'price-ship'})
+    # use strip() to remove blank spaces before and after text
+    shipping = ship_container[0].text.strip()
+
+    print("brand:" + brand)
+    print("product_name:" + product_name)
+    print("shipping:" + shipping)
+
+    f.write(brand + ',' + product_name.replace(',' , '|') + ',' + shipping + '\n')
+
+f.close()
+

Web-Scraping/E-Commerce Website/products.csv

@@ -0,0 +1,13 @@
+brands, product_name, shipping
+GIGABYTE,GIGABYTE GeForce GTX 1070 DirectX 12 GV-N1070WF2OC-8GD Video Cards,Free Shipping
+EVGA,EVGA GeForce GTX 1080 SC GAMING ACX 3.0| 08G-P4-6183-KR| 8GB GDDR5X| LED| DX12 OSD Support (PXOC),Free Shipping
+XFX,XFX Radeon RX 470 RS Triple X DirectX 12 RX-470P436BM 4GB 256-Bit GDDR5 PCI Express 3.0 CrossFireX Support Video Card,$3.99 Shipping
+ASUS,ASUS Radeon RX 480 DirectX 12 DUAL-RX480-O8G Video Card,$4.99 Shipping
+ZOTAC,ZOTAC GeForce GTX 1080 Ti AMP Edition 11GB GDDR5X 352-bit Gaming Graphics Card VR Ready 16+2 Power Phase Freeze Fan Stop IceStorm Cooling Spectra Lighting ZT-P10810D-10P,$6.99 Shipping
+ASUS,ASUS ROG GeForce GTX 1080 STRIX-GTX1080-A8G-GAMING Video Card,Free Shipping
+EVGA,EVGA GeForce GTX 1070 SC GAMING ACX 3.0 Black Edition| 08G-P4-5173-KR| 8GB GDDR5| LED| DX12 OSD Support (PXOC),Free Shipping
+GIGABYTE,GIGABYTE Radeon RX 480 G1 Gaming 4GB GV-RX480G1GAMING-4GD Video Card,$4.99 Shipping
+XFX,XFX Radeon RS RX 480 DirectX 12 RX-480P836BM 8GB 256-Bit GDDR5 PCI Express 3.0 CrossFireX Support Video Card,$4.99 Shipping
+ZOTAC,ZOTAC GeForce GTX 1070 Mini| ZT-P10700G-10M| 8GB GDDR5,Free Shipping
+MSI,MSI Radeon RX 480 DirectX 12 Radeon RX 480 4G Video Card,$4.99 Shipping
+XFX,XFX Radeon GTR RX 480 DirectX 12 RX-480P8DBA6 Black Edition Video Card,$4.99 Shipping