Skip to content

Web Scraping using Python: Tutorial on how to extract data from website using Python

What is Web Scraping?

In simple words, Web Scraping is an extraction of data from a website. For example, some websites contains an extensive amount of invaluable data like stock prices, product’s details and sports stats, so if you want to access their information, either you will copy or paste information manually or write a code (Web Scrapping) that automates it. Web scraping is also known as web data mining or web harvesting.

It is difficult to gather the information automatically from webpage as it is scatter all over and layered in various structures and codes. By using Web scraping it become so easy to structure the data.

Understanding process of Web scraping

Why Python for Web Scraping?

Following reasons makes Python more suitable for Web Scraping:

  • Python has an Enormous collection of Libraries.
  • It has Easily Understandable Syntax.
  • Python has one of the biggest and most active communities, where you can seek help from.
  • Python code is relatively smaller compared to codes of other languages. Means less time to build web scrapper.

How does it Works?

To understand it well, lets scrap Wikipedia to get a detail of S&P 500 Companies. However, you can use the method described here to any extract data from any website.

First things is to establish a connection between Python code and website and get page contents. Every web page is a html page which browser renders to give beautiful looking website.

We can subdivide entire process of web scrapping into following broader areas:

  • Connecting the website and fetching its HTML.
  • Navigating and searching HTML tags for the relevant data and extracting its contents

Python has many libraries that automates all this tasks, so you don’t have to write code for it. Let’s get started.

Web Scraping process using Python, it describes the flow of the flow of the process of web scraping.
Web Scraping Process using Python

Connecting the website and fetching its HTML.

This is the first step of every web scrapping process. You don’t have to write lengthy code for establishing a connection to the website and fetching its HTML. Beauty of Python and its open source library is that we can do it in just one line of code.

Get method of requests library helps to get html contents of the desired url.

Code: Following code, stores the html content of Wikipedia page having details of S&P 500 Companies into a variable named page_html.

#Step-1: Connecting to Website and getting its contents
from requests import get
url = "https://en.wikipedia.org/wiki/List_of_S%26P_500_companies"
page_html = get(url) # To see page content, print(page_html.content)

Navigating and searching HTML tags for the relevant data.

Installing BeautifulSoup4 (BS4)

After getting html page source, getting a list of S&P 500 companies boils down to extracting the contents of appropriate html tags. Although you can write a program that does this task, but Beautiful Soup library of Python makes it super easy. It provides idiomatic ways of navigating and searching HTML and XML. You can pip instal beautifulsoup4 package using the following command. For more details about installation and details of Beautiful Soup package, you can visit here.

pip install beautifulsoup4

Parsing page contents

After importing BeautifulSoup from bs4 library, the next step is to parse the page contents with html parser of BeautifulSoup. This returns a beautiful soup object which gives the ease to navigate and search HTML tags based on various conditions like class and id.

Code: Following code stores the BeautifulSoup object after parsing content of page_html into variable soup.

#Step-2: Parsing page contents using html parser to understand it
from bs4 import BeautifulSoup
soup = BeautifulSoup(page_html.text, 'html.parser')

Wikipedia page contains two tables of which table with constituents as id contains the required data. To extract contents of html tag, Beautiful soup provides two methods i.e. find and find_all. As the name suggest find method will find only the first match however, find_all method finds all the matches. Both the method takes html tag name as an argument that needs to be searched. To narrow down the search, optional HTML/CSS parameters (like class, id, borders, etc) can be passed as a dictionary.

Code: Following code stores the content of table tag with id=’constituents’ into a variable table.

# Step-3: Extracting Table with table id = "constituents" 
table = soup.find('table', {'id': 'constituents'})

Extracting Table Data

It is necessary to understand the structure of the table before extracting its contents. Each row to table is inside ‘tr’ (table row) tag. The first row of table contains the header’s data while each of the remaining rows contains details about a S&P 500 company. Following html code shows the structure of a table.

# Structure of Table containing list of S&P 500 stocks
<tbody><tr>
<th><a href="/wiki/Ticker_symbol" title="Ticker symbol">Symbol</a>
</th>
<th>Security</th>
<th><a href="/wiki/SEC_filing" title="SEC filing">SEC filings</a></th>
<th><a href="/wiki/Global_Industry_Classification_Standard" title="Global Industry Classification Standard">GICS</a> Sector</th>
<th>GICS Sub Industry</th>
<th>Headquarters Location</th>
<th>Date first added</th>
<th><a href="/wiki/Central_Index_Key" title="Central Index Key">CIK</a></th>
<th>Founded
</th></tr>
<tr>
<td><a rel="nofollow" class="external text" href="https://www.nyse.com/quote/XNYS:MMM">MMM</a>
</td>
<td><a href="/wiki/3M" title="3M">3M Company</a></td>
<td><a rel="nofollow" class="external text" href="https://www.sec.gov/cgi-bin/browse-edgar?CIK=MMM&action=getcompany">reports</a></td>
<td>Industrials</td>
<td>Industrial Conglomerates</td>
<td><a href="/wiki/St._Paul,_Minnesota" class="mw-redirect" title="St. Paul, Minnesota">St. Paul, Minnesota</a></td>
<td>1976-08-09</td>
<td>0000066740</td>
<td>1902
</td></tr>
</table>

Extracting Rows of Table

To extract all the rows again, find_all method of BeautifulSoup is used. <tr>…</tr> tags contain data of each row of which the first row contains table header and the remaining rows contain table data.

Code: The following code extracts contents of all the ‘tr’ (table row) tag in table into variable table_rows

# Extracting all table rows
table_rows = table.find_all('tr')

Extracting Table Headers

Header of table contains, Symbol, Security, SEC filings, GICS Sector, GICS Sub Industry, Headquarters Location, Date First added. CIK and Founded. To extract these header data, use find_all method on first row.. Text attribute is used to retrieve the text content.

Code: In the following code, first row is stored in variable header_row. Then all the ‘th’ (table head) tag contents of the first row is stored in variable ths. Using for loop, contents of each table head of ths is appended into header list.

# Getting Table Header Elements from First rows
header = []
header_row = table_rows[0]
ths = header_row.find_all('th')
for th in ths:
    # th contains html 
    # for e.g. ths[0] -> <th><a href="/wiki/Ticker_symbol" title="Ticker symbol">Symbol</a>  </th> 
     # To extract contents (Ticker Symbol) use .text attribute
    header.append(th.text)

Extracting Table Data for Remaining Rows

After getting header’s data from first row, the next step is to extract details of each S&P 500 company. Each row has details about one company. The procedure is very much similar to extracting table header. It is done using nested for loops. The outer for loop navigates through each row and the inner loop navigates through each table data.

Code: Outer for loop navigates through table_rows and stores each table row in variable row. For each row, all the ‘td’ (table data) tags is extracted in variable tds. Nested for loop is used to store text of each ‘td’ into list. Contents of each in variable SP_500.

# Getting Table Data for Remaining Rows
SP_500 = []
# assigning header to data
SP_500.append(header)
for row in table_rows[1:]:
    td_contents = []
    tds = row.find_all('td')
    for td in tds:
        td_contents.append(td.text)
    SP_500.append(td_contents)

Now we have all the details of S&P 500 companies given in Wikipedia in variable SP_500.

Entire Code

from requests import get
from bs4 import BeautifulSoup

url = "https://en.wikipedia.org/wiki/List_of_S%26P_500_companies"
page_html = get(url) # To see page content, print(page_html.content)

#Step-2: Parsing page contents using html parser to understand it
soup = BeautifulSoup(page_html.text, 'html.parser')

# Step-3: Extracting Table with table id = "constituents" 
table = soup.find('table', {'id': 'constituents'})

# Step-4: Extracting all table rows
table_rows = table.find_all('tr')

# Step 5: Extracting Table Header Elements from First rows
header = []
header_row = table_rows[0]
ths = header_row.find_all('th')
for th in ths:
    # th contains html for e.g.
    # ths[0] -> <th><a href="/wiki/Ticker_symbol" title="Ticker symbol">Symbol</a> </th> 
     # To extract contents (Ticker Symbol) use .text attribute
    header.append(th.text)
    
# Step 6: Extracting Table with table id = "constituents" 
table = soup.find('table', {'id': 'constituents'}) 

# Step 7: Extracting Table Data for Remaining Rows
SP_500 = []
# assigning header to data
SP_500.append(header)
for row in table_rows[1:]:
    td_contents = []
    tds = row.find_all('td')
    for td in tds:
        td_contents.append(td.text)
    SP_500.append(td_contents)

Extracted Data:

Symbol
SecuritySEC filingsGICS SectorGICS Sub IndustryHeadquarters LocationDate first addedCIKFounded
MMM
3M CompanyreportsIndustrialsIndustrial ConglomeratesSt. Paul, Minnesota1976-08-0900000667401902
ABT
Abbott LaboratoriesreportsHealth CareHealth Care EquipmentNorth Chicago, Illinois1964-03-3100000018001888
ABBV
AbbVie Inc.reportsHealth CarePharmaceuticalsNorth Chicago, Illinois2012-12-3100015511522013 (1888)
ABMD
ABIOMED IncreportsHealth CareHealth Care EquipmentDanvers, Massachusetts2018-05-3100008150941981
ACN
Accenture plcreportsInformation TechnologyIT Consulting & Other ServicesDublin, Ireland2011-07-0600014673731989
ATVI
Activision BlizzardreportsCommunication ServicesInteractive Home EntertainmentSanta Monica, California2015-08-3100007188772008
ADBE
Adobe Inc.reportsInformation TechnologyApplication SoftwareSan Jose, California1997-05-0500007963431982
AMD
Advanced Micro Devices IncreportsInformation TechnologySemiconductorsSanta Clara, California2017-03-2000000024881969
AAP
Advance Auto PartsreportsConsumer DiscretionaryAutomotive RetailRaleigh, North Carolina2015-07-0900011584491932
AES
AES CorpreportsUtilitiesIndependent Power Producers & Energy TradersArlington, Virginia1998-10-0200008747611981
AFL
AFLAC IncreportsFinancialsLife & Health InsuranceColumbus, Georgia1999-05-2800000049771955
A
Agilent Technologies IncreportsHealth CareHealth Care EquipmentSanta Clara, California2000-06-0500010908721999
APD
Air Products & Chemicals IncreportsMaterialsIndustrial GasesAllentown, Pennsylvania1985-04-3000000029691940
AKAM
Akamai Technologies IncreportsInformation TechnologyInternet Services & InfrastructureCambridge, Massachusetts2007-07-1200010862221998
ALK
Alaska Air Group IncreportsIndustrialsAirlinesSeattle, Washington2016-05-1300007664211985
ALB
Albemarle CorpreportsMaterialsSpecialty ChemicalsCharlotte, North Carolina2016-07-0100009159131994
ARE
Alexandria Real Estate EquitiesreportsReal EstateOffice REITsPasadena, California2017-03-2000010354431994
ALXN
Alexion PharmaceuticalsreportsHealth CareBiotechnologyBoston, Massachusetts2012-05-250000899866
1992
ALGN
Align TechnologyreportsHealth CareHealth Care SuppliesSan Jose, California2017-06-1900010971491997
ALLE
AllegionreportsIndustrialsBuilding ProductsDublin, Ireland2013-12-020001579241
1908
ADS
Alliance Data SystemsreportsInformation TechnologyData Processing & Outsourced ServicesPlano, Texas2013-12-230001101215
1996
LNT
Alliant Energy CorpreportsUtilitiesElectric UtilitiesMadison, Wisconsin2016-07-010000352541
1917
ALL
Allstate CorpreportsFinancialsProperty & Casualty InsuranceNorthfield Township, Illinois1995-07-130000899051
1931
GOOGL
Alphabet Inc. (Class A)reportsCommunication ServicesInteractive Media & ServicesMountain View, California2014-04-030001652044
1998
GOOG
Alphabet Inc. (Class C)reportsCommunication ServicesInteractive Media & ServicesMountain View, California2006-04-030001652044
1998
MO
Altria Group IncreportsConsumer StaplesTobaccoRichmond, Virginia00007641801985
AMZN
Amazon.com Inc.reportsConsumer DiscretionaryInternet & Direct Marketing RetailSeattle, Washington2005-11-180001018724
1994
AMCR
Amcor plcreportsMaterialsPaper PackagingWarmley, Bristol, United Kingdom2019-06-0700017487902019 (1860)
AEE
Ameren CorpreportsUtilitiesMulti-UtilitiesSt. Louis, Missouri1991-09-190001002910
1902
AAL
American Airlines GroupreportsIndustrialsAirlinesFort Worth, Texas2015-03-230000006201
1934
AEP
American Electric PowerreportsUtilitiesElectric UtilitiesColumbus, Ohio00000049041906
AXP
American Express CoreportsFinancialsConsumer FinanceNew York, New York1976-06-300000004962
1850
AIG
American International GroupreportsFinancialsProperty & Casualty InsuranceNew York, New York1980-03-310000005272
1919
AMT
American Tower Corp.reportsReal EstateSpecialized REITsBoston, Massachusetts2007-11-190001053507
1995
AWK
American Water Works Company IncreportsUtilitiesWater UtilitiesCamden, New Jersey2016-03-040001410636
1886
AMP
Ameriprise FinancialreportsFinancialsAsset Management & Custody BanksMinneapolis, Minnesota2005-10-030000820027
1894
ABC
AmerisourceBergen CorpreportsHealth CareHealth Care DistributorsChesterbrook, Pennsylvania2001-08-300001140859
1985
AME
AMETEK Inc.reportsIndustrialsElectrical Components & EquipmentBerwyn, Pennsylvania2013-09-230001037868
1930
AMGN
Amgen Inc.reportsHealth CareBiotechnologyThousand Oaks, California1992-01-020000318154
1980
APH
Amphenol CorpreportsInformation TechnologyElectronic ComponentsWallingford, Connecticut2008-09-300000820313
1932
ADI
Analog Devices, Inc.reportsInformation TechnologySemiconductorsNorwood, Massachusetts1999-10-120000006281
1965
ANSS
ANSYSreportsInformation TechnologyApplication SoftwareCanonsburg, Pennsylvania2017-06-190001013462
1969
ANTM
AnthemreportsHealth CareManaged Health CareIndianapolis, Indiana2002-07-250001156039
2014 (1940s)
AON
Aon plcreportsFinancialsInsurance BrokersLondon, United Kingdom1996-04-230000315293
1982 (1919)
AOS
A.O. Smith CorpreportsIndustrialsBuilding ProductsMilwaukee, Wisconsin2017-07-260000091142
1916
APA
Apache CorporationreportsEnergyOil & Gas Exploration & ProductionHouston, Texas1997-07-280000006769
1954
AIV
Apartment Investment & ManagementreportsReal EstateResidential REITsDenver, Colorado2003-03-140000922864
1994 (1975)
AAPL
Apple Inc.reportsInformation TechnologyTechnology Hardware, Storage & PeripheralsCupertino, California1982-11-300000320193
1977
AMAT
Applied Materials Inc.reportsInformation TechnologySemiconductor EquipmentSanta Clara, California1995-03-160000006951
1967
APTV
Aptiv PLCreportsConsumer DiscretionaryAuto Parts & EquipmentDublin, Ireland2012-12-240001521332
1994
ADM
Archer-Daniels-Midland CoreportsConsumer StaplesAgricultural ProductsChicago, Illinois1981-07-290000007084
1902
ANET
Arista NetworksreportsInformation TechnologyCommunications EquipmentSanta Clara, California2018-08-2800015965322004
AJG
Arthur J. Gallagher & Co.reportsFinancialsInsurance BrokersItasca, Illinois2016-05-310000354190
AIZ
AssurantreportsFinancialsMulti-line InsuranceNew York, New York2007-04-100001267238
T
AT&T Inc.reportsCommunication ServicesIntegrated Telecommunication ServicesDallas, Texas1983-11-30 (1957-03-04)00007327171983 (1885)
ATO
Atmos EnergyreportsUtilitiesGas UtilitiesDallas, Texas2019-02-1500007318021906
ADSK
Autodesk Inc.reportsInformation TechnologyApplication SoftwareSan Rafael, California1989-12-010000769397
ADP
Automatic Data ProcessingreportsInformation TechnologyInternet Services & InfrastructureRoseland, New Jersey1981-03-310000008670
AZO
AutoZone IncreportsConsumer DiscretionarySpecialty StoresMemphis, Tennessee1997-01-020000866787
AVB
AvalonBay Communities, Inc.reportsReal EstateResidential REITsArlington, Virginia[3]2007-01-100000915912
AVY
Avery Dennison CorpreportsMaterialsPaper PackagingGlendale, California1987-12-310000008818
BKR
Baker Hughes CoreportsEnergyOil & Gas Equipment & ServicesHouston, Texas2017-07-0700017016052017
BLL
Ball CorpreportsMaterialsMetal & Glass ContainersBroomfield, Colorado1984-10-310000009389
BAC
Bank of America CorpreportsFinancialsDiversified BanksCharlotte, North Carolina1976-06-300000070858
BK
The Bank of New York Mellon Corp.reportsFinancialsAsset Management & Custody BanksNew York, New York1995-03-310001390777
BAX
Baxter International Inc.reportsHealth CareHealth Care EquipmentDeerfield, Illinois1972-09-3000000104561931
BDX
Becton DickinsonreportsHealth CareHealth Care EquipmentFranklin Lakes, New Jersey1972-09-3000000107951897
BRK.B
Berkshire HathawayreportsFinancialsMulti-Sector HoldingsOmaha, Nebraska2010-02-160001067983
BBY
Best Buy Co. Inc.reportsConsumer DiscretionaryComputer & Electronics RetailRichfield, Minnesota1999-06-290000764478
BIIB
Biogen Inc.reportsHealth CareBiotechnologyCambridge, Massachusetts2003-11-130000875045
BLK
BlackRockreportsFinancialsAsset Management & Custody BanksNew York, New York2011-04-040001364742
BA
Boeing CompanyreportsIndustrialsAerospace & DefenseChicago, Illinois00000129271916
BKNG
Booking Holdings IncreportsConsumer DiscretionaryInternet & Direct Marketing RetailNorwalk, Connecticut2009-11-060001075531
BWA
BorgWarnerreportsConsumer DiscretionaryAuto Parts & EquipmentAuburn Hills, Michigan2011-12-190000908255
BXP
Boston PropertiesreportsReal EstateOffice REITsBoston, Massachusetts2006-04-030001037540
BSX
Boston ScientificreportsHealth CareHealth Care EquipmentMarlborough, Massachusetts[4]1995-02-240000885725
BMY
Bristol-Myers SquibbreportsHealth CareHealth Care DistributorsNew York, New York00000142721989
AVGO
Broadcom Inc.reportsInformation TechnologySemiconductorsSan Jose, California2014-05-0800017301681961
BR
Broadridge Financial SolutionsreportsInformation TechnologyData Processing & Outsourced ServicesLake Success, New York2018-06-1800013833121962
BF.B
Brown-Forman Corp.reportsConsumer StaplesDistillers & VintnersLouisville, Kentucky1982-10-310000014693
CHRW
C. H. Robinson WorldwidereportsIndustrialsAir Freight & LogisticsEden Prairie, Minnesota2007-03-0200010432771905
COG
Cabot Oil & GasreportsEnergyOil & Gas Exploration & ProductionHouston, Texas2008-06-230000858470
CDNS
Cadence Design SystemsreportsInformation TechnologyApplication SoftwareSan Jose, California2017-09-180000813672
CPB
Campbell SoupreportsConsumer StaplesPackaged Foods & MeatsCamden, New Jersey00000167321869
COF
Capital One FinancialreportsFinancialsConsumer FinanceTysons Corner, Virginia1998-07-0100009276281935
CAH
Cardinal Health Inc.reportsHealth CareHealth Care DistributorsDublin, Ohio1997-05-270000721371
KMX
Carmax IncreportsConsumer DiscretionarySpecialty StoresRichmond, Virginia2010-06-280001170010
CCL
Carnival Corp.reportsConsumer DiscretionaryHotels, Resorts & Cruise LinesMiami, Florida1998-12-220000815097
CARR
Carrier GlobalreportsIndustrialsBuilding ProductsPalm Beach Gardens, Florida2020-04-030001783180
CAT
Caterpillar Inc.reportsIndustrialsConstruction Machinery & Heavy TrucksDeerfield, Illinois00000182301925
CBOE
Cboe Global MarketsreportsFinancialsFinancial Exchanges & DataChicago, Illinois2017-03-010001374310
CBRE
CBRE GroupreportsReal EstateReal Estate ServicesLos Angeles, California2006-11-100001138118
CDW
CDWreportsInformation TechnologyTechnology DistributorsLincolnshire, Illinois2019-09-2300014020571984
CE
CelanesereportsMaterialsSpecialty ChemicalsIrving, Texas2018-12-2400013068301918
CNC
Centene CorporationreportsHealth CareManaged Health CareSt Louis, Missouri2016-03-300001071739
CNP
CenterPoint EnergyreportsUtilitiesMulti-UtilitiesHouston, Texas1985-07-310001130310
CTL
CenturyLink IncreportsCommunication ServicesAlternative CarriersMonroe, Louisiana1999-03-250000018926
CERN
CernerreportsHealth CareHealth Care TechnologyNorth Kansas City, Missouri2010-04-300000804753
CF
CF Industries Holdings IncreportsMaterialsFertilizers & Agricultural ChemicalsDeerfield, Illinois2008-08-270001324404
SCHW
Charles Schwab CorporationreportsFinancialsInvestment Banking & BrokerageSan Francisco, California1997-06-020000316709
CHTR
Charter CommunicationsreportsCommunication ServicesCable & SatelliteStamford, Connecticut2016-09-080001091667
CVX
Chevron Corp.reportsEnergyIntegrated Oil & GasSan Ramon, California00000934101879
CMG
Chipotle Mexican GrillreportsConsumer DiscretionaryRestaurantsNewport Beach, California2011-04-280001058090
CB
Chubb LimitedreportsFinancialsProperty & Casualty InsuranceZurich, Switzerland2010-07-150000896159
CHD
Church & DwightreportsConsumer StaplesHousehold ProductsEwing, New Jersey2015-12-290000313927
CI
CIGNA Corp.reportsHealth CareManaged Health CareBloomfield, Connecticut1976-06-300000701221
CINF
Cincinnati FinancialreportsFinancialsProperty & Casualty InsuranceFairfield, Ohio1997-12-180000020286
CTAS
Cintas CorporationreportsIndustrialsDiversified Support ServicesMason, Ohio2001-03-0100007232541929
CSCO
Cisco SystemsreportsInformation TechnologyCommunications EquipmentSan Jose, California1993-12-010000858877
C
Citigroup Inc.reportsFinancialsDiversified BanksNew York, New York1988-05-310000831001
CFG
Citizens Financial GroupreportsFinancialsRegional BanksProvidence, Rhode Island2016-01-290000759944
CTXS
Citrix SystemsreportsInformation TechnologyApplication SoftwareFort Lauderdale, Florida1999-12-010000877890
CLX
The Clorox CompanyreportsConsumer StaplesHousehold ProductsOakland, California1969-03-3100000210761913
CME
CME Group Inc.reportsFinancialsFinancial Exchanges & DataChicago, Illinois2006-08-110001156375
CMS
CMS EnergyreportsUtilitiesMulti-UtilitiesJackson, Michigan1999-05-030000811156
KO
Coca-Cola CompanyreportsConsumer StaplesSoft DrinksAtlanta, Georgia00000213441886
CTSH
Cognizant Technology SolutionsreportsInformation TechnologyIT Consulting & Other ServicesTeaneck, New Jersey2006-11-170001058290
CL
Colgate-PalmolivereportsConsumer StaplesHousehold ProductsNew York, New York00000216651806
CMCSA
Comcast Corp.reportsCommunication ServicesCable & SatellitePhiladelphia, Pennsylvania2015-09-180001166691
CMA
Comerica Inc.reportsFinancialsDiversified BanksDallas, Texas1995-12-010000028412
CAG
Conagra BrandsreportsConsumer StaplesPackaged Foods & MeatsChicago, Illinois1983-08-310000023217
CXO
Concho ResourcesreportsEnergyOil & Gas Exploration & ProductionMidland, Texas2016-02-220001358071
COP
ConocoPhillipsreportsEnergyOil & Gas Exploration & ProductionHouston, Texas00011631652002
ED
Consolidated EdisonreportsUtilitiesElectric UtilitiesNew York, New York00010478621823
STZ
Constellation BrandsreportsConsumer StaplesDistillers & VintnersVictor, New York2005-07-010000016918
COO
The Cooper CompaniesreportsHealth CareHealth Care SuppliesSan Ramon, California2016-09-230000711404
CPRT
Copart IncreportsIndustrialsDiversified Support ServicesDallas, Texas2018-07-0200009000751982
GLW
Corning Inc.reportsInformation TechnologyElectronic ComponentsCorning, New York00000247411851
CTVA
CortevareportsMaterialsFertilizers & Agricultural ChemicalsWilmington, Delaware2019-06-0300017556722019
COST
Costco Wholesale Corp.reportsConsumer StaplesHypermarkets & Super CentersIssaquah, Washington1993-10-010000909832
COTY
Coty, IncreportsConsumer StaplesPersonal ProductsNew York, New York2016-10-030001024305
CCI
Crown Castle International Corp.reportsReal EstateSpecialized REITsHouston, Texas2012-03-140001051470
CSX
CSX Corp.reportsIndustrialsRailroadsJacksonville, Florida1967-09-3000002779481980
CMI
Cummins Inc.reportsIndustrialsIndustrial MachineryColumbus, Indiana1965-03-3100000261721919
CVS
CVS HealthreportsHealth CareHealth Care ServicesWoonsocket, Rhode Island00000648031996
DHI
D. R. HortonreportsConsumer DiscretionaryHomebuildingFort Worth, Texas00008821841978
DHR
Danaher Corp.reportsHealth CareHealth Care EquipmentWashington, D.C.00003136161969
DRI
Darden RestaurantsreportsConsumer DiscretionaryRestaurantsOrlando, Florida00009409441938
DVA
DaVita Inc.reportsHealth CareHealth Care FacilitiesDenver, Colorado2008-07-310000927066
DE
Deere & Co.reportsIndustrialsAgricultural & Farm MachineryMoline, Illinois00003151891837
DAL
Delta Air Lines Inc.reportsIndustrialsAirlinesAtlanta, Georgia2013-09-1100000279041929
XRAY
Dentsply SironareportsHealth CareHealth Care SuppliesCharlotte, North Carolina2008-11-140000818479
DVN
Devon EnergyreportsEnergyOil & Gas Exploration & ProductionOklahoma City, Oklahoma2000-08-300001090012
DXCM
DexComreportsHealth CareHealth Care EquipmentSan Diego, California2020-05-1200010935571999
FANG
Diamondback EnergyreportsEnergyOil & Gas Exploration & ProductionMidland, Texas2018-12-0300015398382007
DLR
Digital Realty Trust IncreportsReal EstateSpecialized REITsSan Francisco, California2016-05-180001297996
DFS
Discover Financial ServicesreportsFinancialsConsumer FinanceRiverwoods, Illinois2007-07-020001393612
DISCA
Discovery, Inc. (Class A)reportsCommunication ServicesBroadcastingSilver Spring, Maryland2010-03-010001437107
DISCK
Discovery, Inc. (Class C)reportsCommunication ServicesBroadcastingSilver Spring, Maryland2014-08-070001437107
DISH
Dish NetworkreportsCommunication ServicesCable & SatelliteMeridian, Colorado2017-03-130001001082
DG
Dollar GeneralreportsConsumer DiscretionaryGeneral Merchandise StoresGoodlettsville, Tennessee2012-12-0300000295341939
DLTR
Dollar TreereportsConsumer DiscretionaryGeneral Merchandise StoresChesapeake, Virginia2011-12-190000935703
D
Dominion EnergyreportsUtilitiesElectric UtilitiesRichmond, Virginia00007159571983
DPZ
Domino's PizzareportsConsumer DiscretionaryRestaurantsAnn Arbor, Michigan2020-05-1200012866811960
DOV
Dover CorporationreportsIndustrialsIndustrial MachineryDowners Grove, Illinois1985-10-3100000299051955
DOW
Dow Inc.reportsMaterialsCommodity ChemicalsMidland, Michigan2019-04-0100017517882019
DTE
DTE Energy Co.reportsUtilitiesMulti-UtilitiesDetroit, Michigan00009363401995
DUK
Duke EnergyreportsUtilitiesElectric UtilitiesCharlotte, North Carolina1976-06-300001326160
DRE
Duke Realty CorpreportsReal EstateIndustrial REITsIndianapolis, Indiana2017-07-260000783280
DD
DuPont de Nemours IncreportsMaterialsSpecialty ChemicalsMidland, Michigan2019-04-0200016667002017
DXC
DXC TechnologyreportsInformation TechnologyIT Consulting & Other ServicesTysons Corner, Virginia2017-04-0400016885682017
ETFC
E*TradereportsFinancialsInvestment Banking & BrokerageNew York, New York2004-03-310001015780
EMN
Eastman ChemicalreportsMaterialsDiversified ChemicalsKingsport, Tennessee1994-01-010000915389
ETN
Eaton CorporationreportsIndustrialsElectrical Components & EquipmentDublin, Ireland00015511821911
EBAY
eBay Inc.reportsConsumer DiscretionaryInternet & Direct Marketing RetailSan Jose, California00010650881995
ECL
Ecolab Inc.reportsMaterialsSpecialty ChemicalsSt. Paul, Minnesota1989-01-310000031462
EIX
Edison Int'lreportsUtilitiesElectric UtilitiesRosemead, California00008270521886
EW
Edwards LifesciencesreportsHealth CareHealth Care EquipmentIrvine, California2011-04-010001099800
EA
Electronic ArtsreportsCommunication ServicesInteractive Home EntertainmentRedwood City, California2002-07-220000712515
EMR
Emerson Electric CompanyreportsIndustrialsElectrical Components & EquipmentFerguson, Missouri1965-03-3100000326041890
ETR
Entergy Corp.reportsUtilitiesElectric UtilitiesNew Orleans, Louisiana00000659841913
EOG
EOG ResourcesreportsEnergyOil & Gas Exploration & ProductionHouston, Texas2000-11-020000821189
EFX
Equifax Inc.reportsIndustrialsResearch & Consulting ServicesAtlanta, Georgia1997-06-1900000331851899
EQIX
EquinixreportsReal EstateSpecialized REITsRedwood City, California2015-03-200001101239
EQR
Equity ResidentialreportsReal EstateResidential REITsChicago, Illinois2001-12-030000906107
ESS
Essex Property Trust, Inc.reportsReal EstateResidential REITsPalo Alto, California2014-04-020000920522
EL
Estée Lauder CompaniesreportsConsumer StaplesPersonal ProductsNew York, New York2006-01-050001001250
EVRG
EvergyreportsUtilitiesElectric UtilitiesKansas City, Missouri2018-06-0500017112691909
ES
Eversource EnergyreportsUtilitiesMulti-UtilitiesSpringfield, Massachusetts00000727411966
RE
Everest Re Group Ltd.reportsFinancialsReinsuranceHamilton, Bermuda2017-06-190001095073
EXC
Exelon Corp.reportsUtilitiesMulti-UtilitiesChicago, Illinois00011093572000
EXPE
Expedia GroupreportsConsumer DiscretionaryInternet & Direct Marketing RetailSeattle, Washington2007-10-020001324424
EXPD
ExpeditorsreportsIndustrialsAir Freight & LogisticsSeattle, Washington2007-10-1000007465151979
EXR
Extra Space StoragereportsReal EstateSpecialized REITsSalt Lake City, Utah2016-01-190001289490
XOM
Exxon Mobil Corp.reportsEnergyIntegrated Oil & GasIrving, Texas00000340881999
FFIV
F5 NetworksreportsInformation TechnologyCommunications EquipmentSeattle, Washington2010-12-2000010486951996
FB
Facebook, Inc.reportsCommunication ServicesInteractive Media & ServicesMenlo Park, California2013-12-230001326801
FAST
Fastenal CoreportsIndustrialsBuilding ProductsWinona, Minnesota2008-09-1500008155561967
FRT
Federal Realty Investment TrustreportsReal EstateRetail REITsRockville, Maryland2016-02-010000034903
FDX
FedEx CorporationreportsIndustrialsAir Freight & LogisticsMemphis, Tennessee1980-12-310001048911
FIS
Fidelity National Information ServicesreportsInformation TechnologyData Processing & Outsourced ServicesJacksonville, Florida2006-11-100001136893
FITB
Fifth Third BancorpreportsFinancialsRegional BanksCincinnati, Ohio00000355271858
FE
FirstEnergy CorpreportsUtilitiesElectric UtilitiesAkron, Ohio00010312961997
FRC
First Republic BankreportsFinancialsRegional BanksSan Francisco, California2019-01-0200011329791985
FISV
Fiserv IncreportsInformation TechnologyData Processing & Outsourced ServicesBrookfield, Wisconsin2001-04-020000798354
FLT
FleetCor Technologies IncreportsInformation TechnologyData Processing & Outsourced ServicesNorcross, Georgia2018-06-2000011754542000
FLIR
FLIR SystemsreportsInformation TechnologyElectronic Equipment & InstrumentsWilsonville, Oregon2009-01-020000354908
FLS
Flowserve CorporationreportsIndustrialsIndustrial MachineryIrving, Texas2008-10-020000030625
FMC
FMC CorporationreportsMaterialsFertilizers & Agricultural ChemicalsPhiladelphia, Pennsylvania2009-08-190000037785
F
Ford Motor CompanyreportsConsumer DiscretionaryAutomobile ManufacturersDearborn, Michigan00000379961903
FTNT
FortinetreportsInformation TechnologySystems SoftwareSunnyvale, California2018-10-1100012620392000
FTV
Fortive CorpreportsIndustrialsIndustrial MachineryEverett, Washington2016-07-0100016591662016
FBHS
Fortune Brands Home & SecurityreportsIndustrialsBuilding ProductsDeerfield, Illinois2016-06-220001519751
FOXA
Fox Corporation (Class A)reportsCommunication ServicesMovies & EntertainmentNew York, New York2013-07-010001308161
FOX
Fox Corporation (Class B)reportsCommunication ServicesMovies & EntertainmentNew York, New York2015-09-180001308161
BEN
Franklin ResourcesreportsFinancialsAsset Management & Custody BanksSan Mateo, California00000387771947
FCX
Freeport-McMoRan Inc.reportsMaterialsCopperPhoenix, Arizona00008312591912
GPS
Gap Inc.reportsConsumer DiscretionaryApparel RetailSan Francisco, California1986-08-310000039911
GRMN
Garmin Ltd.reportsConsumer DiscretionaryConsumer ElectronicsSchaffhausen, Switzerland2012-12-120001121788
IT
Gartner IncreportsInformation TechnologyIT Consulting & Other ServicesStamford, Connecticut2017-04-050000749251
GD
General DynamicsreportsIndustrialsAerospace & DefenseFalls Church, Virginia00000405331899
GE
General ElectricreportsIndustrialsIndustrial ConglomeratesBoston, Massachusetts00000405451892
GIS
General MillsreportsConsumer StaplesPackaged Foods & MeatsGolden Valley, Minnesota1969-03-3100000407041856
GM
General MotorsreportsConsumer DiscretionaryAutomobile ManufacturersDetroit, Michigan2013-06-060001467858
GPC
Genuine PartsreportsConsumer DiscretionarySpecialty StoresAtlanta, Georgia1973-12-3100000409871925
GILD
Gilead SciencesreportsHealth CareBiotechnologyFoster City, California2004-07-010000882095
GL
Globe Life Inc.reportsFinancialsLife & Health InsuranceMcKinney, Texas1989-04-300000320335
GPN
Global Payments Inc.reportsInformation TechnologyData Processing & Outsourced ServicesAtlanta, Georgia2016-04-250001123360
GS
Goldman Sachs GroupreportsFinancialsInvestment Banking & BrokerageNew York, New York2002-07-220000886982
GWW
Grainger (W.W.) Inc.reportsIndustrialsIndustrial MachineryLake Forest, Illinois1981-06-300000277135
HRB
H&R BlockreportsConsumer DiscretionarySpecialized Consumer ServicesKansas City, Missouri1986-11-300000012659
HAL
Halliburton Co.reportsEnergyOil & Gas Equipment & ServicesHouston, Texas00000450121919
HBI
Hanesbrands IncreportsConsumer DiscretionaryApparel, Accessories & Luxury GoodsWinston-Salem, North Carolina2015-03-2000013598412000
HOG
Harley-DavidsonreportsConsumer DiscretionaryMotorcycle ManufacturersMilwaukee, Wisconsin00007939521903
HIG
Hartford Financial Svc.Gp.reportsFinancialsProperty & Casualty InsuranceHartford, Connecticut0000874766
HAS
Hasbro Inc.reportsConsumer DiscretionaryLeisure ProductsPawtucket, Rhode Island1984-09-300000046080
HCA
HCA HealthcarereportsHealth CareHealth Care FacilitiesNashville, Tennessee2015-01-270000860730
PEAK
Healthpeak PropertiesreportsReal EstateHealth Care REITsLong Beach, California2008-03-310000765880
HP
Helmerich & PaynereportsEnergyOil & Gas DrillingTulsa, Oklahoma[5]2010-03-010000046765
HSIC
Henry ScheinreportsHealth CareHealth Care DistributorsMelville, New York2015-03-170001000228
HSY
The Hershey CompanyreportsConsumer StaplesPackaged Foods & MeatsHershey, Pennsylvania00000471111894
HES
Hess CorporationreportsEnergyIntegrated Oil & GasNew York, New York1984-05-310000004447
HPE
Hewlett Packard EnterprisereportsInformation TechnologyTechnology Hardware, Storage & PeripheralsPalo Alto, California2015-11-0200016455902015
HLT
Hilton Worldwide Holdings IncreportsConsumer DiscretionaryHotels, Resorts & Cruise LinesTysons Corner, Virginia2017-06-1900015856891919
HFC
HollyFrontier CorpreportsEnergyOil & Gas Refining & MarketingDallas, Texas2018-06-180000048039
HOLX
HologicreportsHealth CareHealth Care EquipmentMarlborough, Massachusetts2016-03-300000859737
HD
Home DepotreportsConsumer DiscretionaryHome Improvement RetailAtlanta, Georgia1988-03-310000354950
HON
Honeywell Int'l Inc.reportsIndustrialsIndustrial ConglomeratesMorristown, New Jersey1964-03-3100007738401906
HRL
Hormel Foods Corp.reportsConsumer StaplesPackaged Foods & MeatsAustin, Minnesota2009-03-040000048465
HST
Host Hotels & ResortsreportsReal EstateHotel & Resort REITsBethesda, Maryland2007-03-200001070750
HWM
Howmet AerospacereportsIndustrialsAerospace & DefenseNew York, New York1964-03-3100000042812016
HPQ
HP Inc.reportsInformation TechnologyTechnology Hardware, Storage & PeripheralsPalo Alto, California1974-12-3100000472171939 (2015)
HUM
Humana Inc.reportsHealth CareManaged Health CareLouisville, Kentucky00000490711961
HBAN
Huntington BancsharesreportsFinancialsRegional BanksColumbus, Ohio00000491961866
HII
Huntington Ingalls IndustriesreportsIndustrialsAerospace & DefenseNewport News, Virginia2018-01-030001501585
IEX
IDEX CorporationreportsIndustrialsIndustrial MachineryLake Forest, Illinois2019-08-0900008321011988
IDXX
IDEXX LaboratoriesreportsHealth CareHealth Care EquipmentWestbrook, Maine2017-01-050000874716
INFO
IHS Markit Ltd.reportsIndustrialsResearch & Consulting ServicesLondon, United Kingdom2017-06-020001598014
ITW
Illinois Tool WorksreportsIndustrialsIndustrial MachineryGlenview, Illinois1986-02-280000049826
ILMN
Illumina IncreportsHealth CareLife Sciences Tools & ServicesSan Diego, California2015-11-190001110803
INCY
IncytereportsHealth CareBiotechnologyWilmington, Delaware2017-02-280000879169
IR
Ingersoll RandreportsIndustrialsIndustrial MachineryMilwaukee, Wisconsin2020-03-0300016991501859
INTC
Intel Corp.reportsInformation TechnologySemiconductorsSanta Clara, California1976-12-310000050863
ICE
Intercontinental ExchangereportsFinancialsFinancial Exchanges & DataAtlanta, Georgia2007-09-2600015719492000
IBM
International Business MachinesreportsInformation TechnologyIT Consulting & Other ServicesArmonk, New York00000511431911
IP
International PaperreportsMaterialsPaper PackagingMemphis, Tennessee00000514341898
IPG
Interpublic GroupreportsCommunication ServicesAdvertisingNew York, New York1992-10-010000051644
IFF
Intl Flavors & FragrancesreportsMaterialsSpecialty ChemicalsNew York, New York1976-03-310000051253
INTU
Intuit Inc.reportsInformation TechnologyApplication SoftwareMountain View, California2000-12-050000896878
ISRG
Intuitive Surgical Inc.reportsHealth CareHealth Care EquipmentSunnyvale, California2008-06-020001035267
IVZ
Invesco Ltd.reportsFinancialsAsset Management & Custody BanksAtlanta, Georgia2008-08-210000914208
IPGP
IPG Photonics Corp.reportsInformation TechnologyElectronic Manufacturing ServicesOxford, Massachusetts2018-03-070001111928
IQV
IQVIA Holdings Inc.reportsHealth CareLife Sciences Tools & ServicesDurham, North Carolina2017-08-290001478242
IRM
Iron Mountain IncorporatedreportsReal EstateSpecialized REITsBoston, Massachusetts2009-01-060001020569
JKHY
Jack Henry & AssociatesreportsInformation TechnologyData Processing & Outsourced ServicesMonett, Missouri2018-11-1300007791521976
J
Jacobs Engineering GroupreportsIndustrialsConstruction & EngineeringDallas, Texas2007-10-260000052988
JBHT
J. B. Hunt Transport ServicesreportsIndustrialsTruckingLowell, Arkansas2015-07-010000728535
SJM
JM SmuckerreportsConsumer StaplesPackaged Foods & MeatsOrrville, Ohio2008-11-060000091419
JNJ
Johnson & JohnsonreportsHealth CarePharmaceuticalsNew Brunswick, New Jersey1973-06-3000002004061886
JCI
Johnson Controls InternationalreportsIndustrialsBuilding ProductsCork, Ireland2010-08-270000833444
JPM
JPMorgan Chase & Co.reportsFinancialsDiversified BanksNew York, New York1975-06-300000019617
JNPR
Juniper NetworksreportsInformation TechnologyCommunications EquipmentSunnyvale, California2006-06-0200010436041996
KSU
Kansas City SouthernreportsIndustrialsRailroadsKansas City, Missouri2013-05-240000054480
K
Kellogg Co.reportsConsumer StaplesPackaged Foods & MeatsBattle Creek, Michigan00000550671906
KEY
KeyCorpreportsFinancialsRegional BanksCleveland, Ohio1994-03-010000091576
KEYS
Keysight TechnologiesreportsInformation TechnologyElectronic Equipment & InstrumentsSanta Rosa, California2018-11-0600016010462014
KMB
Kimberly-ClarkreportsConsumer StaplesHousehold ProductsIrving, Texas00000557851872
KIM
Kimco RealtyreportsReal EstateRetail REITsNew Hyde Park, New York2006-04-040000879101
KMI
Kinder MorganreportsEnergyOil & Gas Storage & TransportationHouston, Texas2012-05-250001506307
KLAC
KLA CorporationreportsInformation TechnologySemiconductor EquipmentMilpitas, California00003192011975/1977 (1997)
KSS
Kohl's Corp.reportsConsumer DiscretionaryGeneral Merchandise StoresMenomonee Falls, Wisconsin00008856391962
KHC
Kraft Heinz CoreportsConsumer StaplesPackaged Foods & MeatsChicago, Illinois; Pittsburgh, Pennsylvania2015-07-0600016374592015 (1869)
KR
Kroger Co.reportsConsumer StaplesFood RetailCincinnati, Ohio00000568731883
LB
L Brands Inc.reportsConsumer DiscretionaryApparel RetailColumbus, Ohio1983-09-300000701985
LHX
L3Harris TechnologiesreportsIndustrialsAerospace & DefenseMelbourne, Florida0000202058
LH
Laboratory Corp. of America HoldingreportsHealth CareHealth Care ServicesBurlington, North Carolina2004-11-010000920148
LRCX
Lam ResearchreportsInformation TechnologySemiconductor EquipmentFremont, California2012-06-290000707549
LW
Lamb Weston Holdings IncreportsConsumer StaplesPackaged Foods & MeatsEagle, Idaho2018-12-0300016792732016 (1950)
LVS
Las Vegas SandsreportsConsumer DiscretionaryCasinos & GamingLas Vegas, Nevada2019-10-0300013005141988
LEG
Leggett & PlattreportsConsumer DiscretionaryHome FurnishingsCarthage, Missouri00000584921883
LDOS
Leidos HoldingsreportsInformation TechnologyIT Consulting & Other ServicesReston, Virginia2019-08-0900013369201969
LEN
Lennar Corp.reportsConsumer DiscretionaryHomebuildingMiami, Florida2005-10-040000920760
LLY
Lilly (Eli) & Co.reportsHealth CarePharmaceuticalsIndianapolis, Indiana1970-12-3100000594781876
LNC
Lincoln NationalreportsFinancialsMulti-line InsuranceRadnor, Pennsylvania1976-06-300000059558
LIN
Linde plcreportsMaterialsIndustrial GasesGuildford, Surrey, United Kingdom1992-07-0100017079251879
LYV
Live Nation EntertainmentreportsCommunication ServicesMovies & EntertainmentBeverly Hills, California2019-12-2300013352582010
LKQ
LKQ CorporationreportsConsumer DiscretionaryDistributorsChicago, Illinois2016-05-230001065696
LMT
Lockheed Martin Corp.reportsIndustrialsAerospace & DefenseBethesda, Maryland1984-07-310000936468
L
Loews Corp.reportsFinancialsMulti-line InsuranceNew York, New York0000060086
LOW
Lowe's Cos.reportsConsumer DiscretionaryHome Improvement RetailMooresville, North Carolina1984-02-2900000606671904/1946/1959
LYB
LyondellBasellreportsMaterialsSpecialty ChemicalsRotterdam, Netherlands2012-09-050001489393
MTB
M&T Bank Corp.reportsFinancialsRegional BanksBuffalo, New York00000362701856
MRO
Marathon Oil Corp.reportsEnergyOil & Gas Exploration & ProductionHouston, Texas1991-05-010000101778
MPC
Marathon PetroleumreportsEnergyOil & Gas Refining & MarketingFindlay, Ohio2011-07-010001510295
MKTX
MarketAxessreportsFinancialsFinancial Exchanges & DataNew York, New York2019-07-010001278021
2000
MAR
Marriott Int'l.reportsConsumer DiscretionaryHotels, Resorts & Cruise LinesBethesda, Maryland00010482861927
MMC
Marsh & McLennanreportsFinancialsInsurance BrokersNew York, New York1987-08-310000062709
MLM
Martin Marietta MaterialsreportsMaterialsConstruction MaterialsRaleigh, North Carolina2014-07-020000916076
MAS
Masco Corp.reportsIndustrialsBuilding ProductsLivonia, Michigan1981-06-300000062996
MA
Mastercard Inc.reportsInformation TechnologyData Processing & Outsourced ServicesHarrison, New York2008-07-180001141391
MKC
McCormick & Co.reportsConsumer StaplesPackaged Foods & MeatsHunt Valley, Maryland00000637541889
MXIM
Maxim Integrated Products IncreportsInformation TechnologySemiconductorsSan Jose, California2018-12-0300007433161983
MCD
McDonald's Corp.reportsConsumer DiscretionaryRestaurantsChicago, Illinois1970-06-3000000639081940
MCK
McKesson Corp.reportsHealth CareHealth Care DistributorsIrving, Texas00009276531833
MDT
Medtronic plcreportsHealth CareHealth Care EquipmentDublin, Ireland1986-10-3100016131031949
MRK
Merck & Co.reportsHealth CarePharmaceuticalsKenilworth, New Jersey00003101581891
MET
MetLife Inc.reportsFinancialsLife & Health InsuranceNew York, New York00010992191868
MTD
Mettler ToledoreportsHealth CareLife Sciences Tools & ServicesColumbus, Ohio2016-09-060001037646
MGM
MGM Resorts InternationalreportsConsumer DiscretionaryCasinos & GamingParadise, Nevada2017-07-260000789570
MCHP
Microchip TechnologyreportsInformation TechnologySemiconductorsChandler, Arizona2007-09-070000827054
MU
Micron TechnologyreportsInformation TechnologySemiconductorsBoise, Idaho1994-09-270000723125
MSFT
Microsoft Corp.reportsInformation TechnologySystems SoftwareRedmond, Washington1994-06-0100007890191975
MAA
Mid-America ApartmentsreportsReal EstateResidential REITsMemphis, Tennessee2016-12-020000912595
MHK
Mohawk IndustriesreportsConsumer DiscretionaryHome FurnishingsCalhoun, Georgia2013-12-230000851968
TAP
Molson Coors Brewing CompanyreportsConsumer StaplesBrewersDenver, Colorado1976-06-300000024545
MDLZ
Mondelez InternationalreportsConsumer StaplesPackaged Foods & MeatsChicago, Illinois2012-10-020001103982
MNST
Monster BeveragereportsConsumer StaplesSoft DrinksCorona, California2012-06-280000865752
MCO
Moody's CorpreportsFinancialsFinancial Exchanges & DataNew York, New York00010595561909
MS
Morgan StanleyreportsFinancialsInvestment Banking & BrokerageNew York, New York00008954211935
MOS
The Mosaic CompanyreportsMaterialsFertilizers & Agricultural ChemicalsTampa, Florida2011-09-260001285785
MSI
Motorola Solutions Inc.reportsInformation TechnologyCommunications EquipmentChicago, Illinois00000685051928 (2011)
MSCI
MSCI IncreportsFinancialsFinancial Exchanges & DataNew York, New York2018-04-040001408198
MYL
Mylan N.V.reportsHealth CarePharmaceuticalsAmsterdam, Netherlands2004-04-2300016236131961
NDAQ
Nasdaq, Inc.reportsFinancialsFinancial Exchanges & DataNew York, New York2008-10-220001120193
NOV
National Oilwell Varco Inc.reportsEnergyOil & Gas Equipment & ServicesHouston, Texas2005-03-140001021860
NTAP
NetAppreportsInformation TechnologyTechnology Hardware, Storage & PeripheralsSunnyvale, California1999-06-250001002047
NFLX
Netflix Inc.reportsCommunication ServicesMovies & EntertainmentLos Gatos, California2010-12-2000010652801997
NWL
Newell BrandsreportsConsumer DiscretionaryHousewares & SpecialtiesAtlanta, Georgia1989-04-300000814453
NEM
Newmont CorporationreportsMaterialsGoldDenver, Colorado1969-06-3000011647271921
NWSA
News Corp. Class AreportsCommunication ServicesPublishingNew York, New York2013-08-010001564708
NWS
News Corp. Class BreportsCommunication ServicesPublishingNew York, New York2015-09-180001564708
NEE
NextEra EnergyreportsUtilitiesMulti-UtilitiesJuno Beach, Florida1976-06-300000753308
NLSN
Nielsen HoldingsreportsIndustrialsResearch & Consulting ServicesNew York, New York2013-07-090001492633
NKE
NikereportsConsumer DiscretionaryApparel, Accessories & Luxury GoodsWashington County, Oregon1988-11-300000320187
NI
NiSource Inc.reportsUtilitiesMulti-UtilitiesMerrillville, Indiana00011117111912
NBL
Noble Energy IncreportsEnergyOil & Gas Exploration & ProductionHouston, Texas2007-10-080000072207
JWN
NordstromreportsConsumer DiscretionaryDepartment StoresSeattle, Washington1986-08-310000072333
NSC
Norfolk Southern Corp.reportsIndustrialsRailroadsNorfolk, Virginia00007021651881/1894 (1980)
NTRS
Northern Trust Corp.reportsFinancialsAsset Management & Custody BanksChicago, Illinois00000731241889
NOC
Northrop GrummanreportsIndustrialsAerospace & DefenseWest Falls Church, Virginia1985-06-300001133421
NLOK
NortonLifeLockreportsInformation TechnologyApplication SoftwareTempe, Arizona2003-03-250000849399
NCLH
Norwegian Cruise Line HoldingsreportsConsumer DiscretionaryHotels, Resorts & Cruise LinesMiami, Florida2017-10-130001513761
NRG
NRG EnergyreportsUtilitiesIndependent Power Producers & Energy TradersPrinceton, New Jersey2010-01-290001013871
NUE
Nucor Corp.reportsMaterialsSteelCharlotte, North Carolina1985-04-300000073309
NVDA
Nvidia CorporationreportsInformation TechnologySemiconductorsSanta Clara, California2001-11-300001045810
NVR
NVR IncreportsConsumer DiscretionaryHomebuildingReston, VA2019-09-2600009061631980
ORLY
O'Reilly AutomotivereportsConsumer DiscretionarySpecialty StoresSpringfield, Missouri2009-03-270000898173
OXY
Occidental PetroleumreportsEnergyOil & Gas Exploration & ProductionHouston, Texas1982-12-310000797468
ODFL
Old Dominion Freight LinereportsIndustrialsTruckingThomasville, North Carolina2019-12-0900008789271934
OMC
Omnicom GroupreportsCommunication ServicesAdvertisingNew York, New York00000299891986
OKE
ONEOKreportsEnergyOil & Gas Storage & TransportationTulsa, Oklahoma2010-03-150001039684
ORCL
Oracle Corp.reportsInformation TechnologyApplication SoftwareRedwood Shores, California1989-08-310001341439
OTIS
Otis WorldwidereportsIndustrialsIndustrial MachineryFarmington, Connecticut2020-04-030001781335
PCAR
PACCAR Inc.reportsIndustrialsConstruction Machinery & Heavy TrucksBellevue, Washington1980-12-310000075362
PKG
Packaging Corporation of AmericareportsMaterialsPaper PackagingLake Forest, Illinois2017-07-260000075677
PH
Parker-HannifinreportsIndustrialsIndustrial MachineryCleveland, Ohio1985-11-300000076334
PAYX
Paychex Inc.reportsInformation TechnologyData Processing & Outsourced ServicesPenfield, New York00007235311971
PAYC
PaycomreportsInformation TechnologyApplication SoftwareOklahoma City, Oklahoma2020-01-2800015909551998
PYPL
PayPalreportsInformation TechnologyData Processing & Outsourced ServicesSan Jose, California2015-07-2000016339171998
PNR
Pentair plcreportsIndustrialsIndustrial MachineryWorsley, UK2012-10-010000077360
PBCT
People's United FinancialreportsFinancialsThrifts & Mortgage FinanceBridgeport, Connecticut2008-11-130001378946
PEP
PepsiCo Inc.reportsConsumer StaplesSoft DrinksPurchase, New York00000774761898
PKI
PerkinElmerreportsHealth CareHealth Care EquipmentWaltham, Massachusetts1985-05-310000031791
PRGO
PerrigoreportsHealth CarePharmaceuticalsDublin, Ireland2011-12-190001585364
PFE
Pfizer Inc.reportsHealth CarePharmaceuticalsNew York, New York00000780031849
PM
Philip Morris InternationalreportsConsumer StaplesTobaccoNew York, New York2008-03-310001413329
PSX
Phillips 66reportsEnergyOil & Gas Refining & MarketingHouston, Texas2012-05-010001534701
PNW
Pinnacle West CapitalreportsUtilitiesMulti-UtilitiesPhoenix, Arizona00007646221985
PXD
Pioneer Natural ResourcesreportsEnergyOil & Gas Exploration & ProductionIrving, Texas2008-09-240001038357
PNC
PNC Financial ServicesreportsFinancialsRegional BanksPittsburgh, Pennsylvania1988-04-300000713676
PPG
PPG IndustriesreportsMaterialsSpecialty ChemicalsPittsburgh, Pennsylvania00000798791883
PPL
PPL Corp.reportsUtilitiesElectric UtilitiesAllentown, Pennsylvania0000922224
PFG
Principal Financial GroupreportsFinancialsLife & Health InsuranceDes Moines, Iowa2002-07-220001126328
PG
Procter & GamblereportsConsumer StaplesPersonal ProductsCincinnati, Ohio00000804241837
PGR
Progressive Corp.reportsFinancialsProperty & Casualty InsuranceMayfield Village, Ohio1997-08-040000080661
PLD
PrologisreportsReal EstateIndustrial REITsSan Francisco, California2003-07-170001045609
PRU
Prudential FinancialreportsFinancialsLife & Health InsuranceNewark, New Jersey2002-07-220001137774
PEG
Public Serv. Enterprise Inc.reportsUtilitiesElectric UtilitiesNewark, New Jersey0000788784
PSA
Public StoragereportsReal EstateSpecialized REITsGlendale, California2005-08-190001393311
PHM
PulteGroupreportsConsumer DiscretionaryHomebuildingAtlanta, Georgia1984-04-300000822416
PVH
PVH Corp.reportsConsumer DiscretionaryApparel, Accessories & Luxury GoodsNew York, New York2013-02-150000078239
QRVO
QorvoreportsInformation TechnologySemiconductorsGreensboro, North Carolina2015-06-1100016047782015
PWR
Quanta Services Inc.reportsIndustrialsConstruction & EngineeringHouston, Texas2009-07-010001050915
QCOM
QUALCOMM Inc.reportsInformation TechnologySemiconductorsSan Diego, California00008043281985
DGX
Quest DiagnosticsreportsHealth CareHealth Care ServicesSecaucus, New Jersey2002-12-120001022079
RL
Ralph Lauren CorporationreportsConsumer DiscretionaryApparel, Accessories & Luxury GoodsNew York, New York2007-02-020001037038
RJF
Raymond James Financial Inc.reportsFinancialsInvestment Banking & BrokerageSt. Petersburg, Florida2017-03-200000720005
RTX
Raytheon TechnologiesreportsIndustrialsAerospace & DefenseWaltham, Massachusetts00001018291922
O
Realty Income CorporationreportsReal EstateRetail REITsSan Diego, California2015-04-070000726728
REG
Regency Centers CorporationreportsReal EstateRetail REITsJacksonville, Florida2017-03-020000910606
REGN
Regeneron PharmaceuticalsreportsHealth CareBiotechnologyTarrytown, New York2013-05-010000872589
RF
Regions Financial Corp.reportsFinancialsRegional BanksBirmingham, Alabama1998-08-280001281761
RSG
Republic Services IncreportsIndustrialsEnvironmental & Facilities ServicesPhoenix, Arizona2008-12-050001060391
RMD
ResMedreportsHealth CareHealth Care EquipmentSan Diego, California2017-07-260000943819
RHI
Robert Half InternationalreportsIndustrialsHuman Resource & Employment ServicesMenlo Park, California2000-12-050000315213
ROK
Rockwell Automation Inc.reportsIndustrialsElectrical Components & EquipmentMilwaukee, Wisconsin0001024478
ROL
Rollins Inc.reportsIndustrialsEnvironmental & Facilities ServicesAtlanta, Georgia2018-10-0100000848391948
ROP
Roper TechnologiesreportsIndustrialsIndustrial ConglomeratesSarasota, Florida2009-12-230000882835
ROST
Ross StoresreportsConsumer DiscretionaryApparel RetailDublin, California2009-12-210000745732
RCL
Royal Caribbean Cruises LtdreportsConsumer DiscretionaryHotels, Resorts & Cruise LinesMiami, Florida2014-12-050000884887
SPGI
S&P Global, Inc.reportsFinancialsFinancial Exchanges & DataNew York, New York0000064040
CRM
Salesforce.comreportsInformation TechnologyApplication SoftwareSan Francisco, California2008-09-150001108524
SBAC
SBA CommunicationsreportsReal EstateSpecialized REITsBoca Raton, Florida2017-09-010001034054
SLB
Schlumberger Ltd.reportsEnergyOil & Gas Equipment & ServicesCuraçao, Kingdom of the Netherlands1965-03-3100000873471926
STX
Seagate TechnologyreportsInformation TechnologyTechnology Hardware, Storage & PeripheralsDublin, Ireland2012-07-020001137789
SEE
Sealed AirreportsMaterialsPaper PackagingCharlotte, North Carolina00010121001960
SRE
Sempra EnergyreportsUtilitiesMulti-UtilitiesSan Diego, California00010322081998
NOW
ServiceNowreportsInformation TechnologySystems SoftwareSanta Clara, California2019-11-2100013737152003
SHW
Sherwin-WilliamsreportsMaterialsSpecialty ChemicalsCleveland, Ohio1964-06-3000000898001866
SPG
Simon Property Group IncreportsReal EstateRetail REITsIndianapolis, Indiana2002-06-260001063761
2003
SWKS
Skyworks SolutionsreportsInformation TechnologySemiconductorsWoburn, Massachusetts2015-03-120000004127
SLG
SL Green RealtyreportsReal EstateOffice REITsNew York, New York2015-03-200001040971
SNA
Snap-onreportsIndustrialsIndustrial MachineryKenosha, Wisconsin1982-09-300000091440
1920
SO
Southern CompanyreportsUtilitiesElectric UtilitiesAtlanta, Georgia00000921221945
LUV
Southwest AirlinesreportsIndustrialsAirlinesDallas, Texas1994-07-010000092380
SWK
Stanley Black & DeckerreportsIndustrialsIndustrial MachineryNew Britain, Connecticut1982-09-300000093556
SBUX
Starbucks Corp.reportsConsumer DiscretionaryRestaurantsSeattle, Washington00008292241971
STT
State Street Corp.reportsFinancialsAsset Management & Custody BanksBoston, Massachusetts00000937511792
STE
STERIS plcreportsHealth CareHealth Care EquipmentDublin, Ireland2019-12-2300017578981985
SYK
Stryker Corp.reportsHealth CareHealth Care EquipmentKalamazoo, Michigan2000-12-120000310764
SIVB
SVB FinancialreportsFinancialsRegional BanksSanta Clara, California2018-03-190000719739
SYF
Synchrony FinancialreportsFinancialsConsumer FinanceStamford, Connecticut2015-11-1800016017122003
SNPS
Synopsys Inc.reportsInformation TechnologyApplication SoftwareMountain View, California2017-03-160000883241
SYY
Sysco Corp.reportsConsumer StaplesFood DistributorsHouston, Texas1986-12-310000096021
TMUS
T-Mobile USreportsCommunication ServicesWireless Telecommunication ServicesBellevue, Washington2019-07-1500012836991994
TROW
T. Rowe Price GroupreportsFinancialsAsset Management & Custody BanksBaltimore, Maryland00011131691937
TTWO
Take-Two InteractivereportsCommunication ServicesInteractive Home EntertainmentNew York, New York2018-03-190000946581
TPR
Tapestry, Inc.reportsConsumer DiscretionaryApparel, Accessories & Luxury GoodsNew York, New York00011161322017
TGT
Target Corp.reportsConsumer DiscretionaryGeneral Merchandise StoresMinneapolis, Minnesota1976-12-310000027419
TEL
TE Connectivity Ltd.reportsInformation TechnologyElectronic Manufacturing ServicesSchaffhausen, Switzerland2011-10-170001385157
FTI
TechnipFMCreportsEnergyOil & Gas Equipment & ServicesLondon, United Kingdom2009-06-0500016814592017 (1958)
TFX
TeleflexreportsHealth CareHealth Care EquipmentWayne, Pennsylvania2019-01-1800000969431943
TXN
Texas InstrumentsreportsInformation TechnologySemiconductorsDallas, Texas00000974761930
TXT
Textron Inc.reportsIndustrialsAerospace & DefenseProvidence, Rhode Island1978-12-310000217346
TMO
Thermo Fisher ScientificreportsHealth CareLife Sciences Tools & ServicesWaltham, Massachusetts00000977452006 (1902)
TIF
Tiffany & Co.reportsConsumer DiscretionaryApparel, Accessories & Luxury GoodsNew York, New York2000-06-210000098246
TJX
TJX Companies Inc.reportsConsumer DiscretionaryApparel RetailFramingham, Massachusetts1985-09-300000109198
TSCO
Tractor Supply CompanyreportsConsumer DiscretionarySpecialty StoresBrentwood, Tennessee2014-01-240000916365
TT
Trane Technologies plcreportsIndustrialsBuilding ProductsDublin, Ireland2010-11-170001466258
TDG
TransDigm GroupreportsIndustrialsAerospace & DefenseCleveland, Ohio2016-06-030001260221
TRV
The Travelers Companies Inc.reportsFinancialsProperty & Casualty InsuranceNew York, New York2002-08-210000086312
TFC
Truist FinancialreportsFinancialsRegional BanksCharlotte, North Carolina1997-12-040000092230
TWTR
Twitter, Inc.reportsCommunication ServicesInteractive Media & ServicesSan Francisco, California2018-06-070001418091
TSN
Tyson FoodsreportsConsumer StaplesPackaged Foods & MeatsSpringdale, Arkansas00001004931935
UDR
UDR, Inc.reportsReal EstateResidential REITsHighlands Ranch, Colorado2016-03-070000074208
ULTA
Ulta BeautyreportsConsumer DiscretionarySpecialty StoresBolingbrook, Illinois2016-04-1800014035681990
USB
U.S. BancorpreportsFinancialsDiversified BanksMinneapolis, Minnesota00000361041968
UAA
Under Armour (Class A)reportsConsumer DiscretionaryApparel, Accessories & Luxury GoodsBaltimore, Maryland2014-05-010001336917
UA
Under Armour (Class C)reportsConsumer DiscretionaryApparel, Accessories & Luxury GoodsBaltimore, Maryland2016-04-080001336917
UNP
Union Pacific CorpreportsIndustrialsRailroadsOmaha, Nebraska00001008851862
UAL
United Airlines HoldingsreportsIndustrialsAirlinesChicago, Illinois2015-09-0300001005171967
UNH
United Health Group Inc.reportsHealth CareManaged Health CareMinnetonka, Minnesota1994-07-010000731766
UPS
United Parcel ServicereportsIndustrialsAir Freight & LogisticsAtlanta, Georgia2002-07-2200010907271907
URI
United Rentals, Inc.reportsIndustrialsTrading Companies & DistributorsStamford, Connecticut2014-09-2000010677011997
UHS
Universal Health Services, Inc.reportsHealth CareHealth Care FacilitiesKing of Prussia, Pennsylvania2014-09-200000352915
UNM
Unum GroupreportsFinancialsLife & Health InsuranceChattanooga, Tennessee1994-03-010000005513
VFC
V.F. Corp.reportsConsumer DiscretionaryApparel, Accessories & Luxury GoodsGreensboro, North Carolina1979-06-300000103379
VLO
Valero EnergyreportsEnergyOil & Gas Refining & MarketingSan Antonio, Texas00010350021980
VAR
Varian Medical SystemsreportsHealth CareHealth Care EquipmentPalo Alto, California2007-02-120000203527
VTR
Ventas IncreportsReal EstateHealth Care REITsChicago, Illinois2009-03-040000740260
VRSN
Verisign Inc.reportsInformation TechnologyInternet Services & InfrastructureDulles, Virginia2006-02-010001014473
VRSK
Verisk AnalyticsreportsIndustrialsResearch & Consulting ServicesJersey City, New Jersey2015-10-0800014421451971
VZ
Verizon CommunicationsreportsCommunication Services
Integrated Telecommunication ServicesNew York, New York1983-11-300000732712
VRTX
Vertex Pharmaceuticals IncreportsHealth CareBiotechnologyCambridge, Massachusetts2013-09-230000875320
VIAC
ViacomCBSreportsCommunication ServicesMovies & EntertainmentNew York, New York0001339947
V
Visa Inc.reportsInformation TechnologyData Processing & Outsourced ServicesSan Francisco, California2009-12-210001403161
VNO
Vornado Realty TrustreportsReal EstateOffice REITsNew York, New York00008996891982
VMC
Vulcan MaterialsreportsMaterialsConstruction MaterialsBirmingham, Alabama1999-06-300001396009
WRB
W. R. Berkley CorporationreportsFinancialsProperty & Casualty InsuranceGreenwich, Connecticut2019-12-0500000115441967
WAB
Wabtec CorporationreportsIndustrialsConstruction Machinery & Heavy TrucksWilmerding, Pennsylvania2019-02-2700009434521999 (1869)
WMT
WalmartreportsConsumer StaplesHypermarkets & Super CentersBentonville, Arkansas1982-08-310000104169
WBA
Walgreens Boots AlliancereportsConsumer StaplesDrug RetailDeerfield, Illinois1979-12-3100016189212014
DIS
The Walt Disney CompanyreportsCommunication ServicesMovies & EntertainmentBurbank, California1976-06-300001001039
WM
Waste Management Inc.reportsIndustrialsEnvironmental & Facilities ServicesHouston, Texas00008237681968
WAT
Waters CorporationreportsHealth CareHealth Care DistributorsMilford, Massachusetts00010006971958
WEC
WEC Energy GroupreportsUtilitiesElectric UtilitiesMilwaukee, Wisconsin2008-10-310000783325
WFC
Wells FargoreportsFinancialsDiversified BanksSan Francisco, California1976-06-300000072971
WELL
Welltower Inc.reportsReal EstateHealth Care REITsToledo, Ohio2009-01-300000766704
WDC
Western DigitalreportsInformation TechnologyTechnology Hardware, Storage & PeripheralsIrvine, California2009-07-010000106040
WU
Western Union CoreportsInformation TechnologyData Processing & Outsourced ServicesEnglewood, Colorado00013651351851
WRK
WestRockreportsMaterialsPaper PackagingRichmond, Virginia00016360232015
WY
WeyerhaeuserreportsReal EstateSpecialized REITsFederal Way, Washington00001065351900
WHR
Whirlpool Corp.reportsConsumer DiscretionaryHousehold AppliancesBenton Harbor, Michigan00001066401911
WMB
Williams Cos.reportsEnergyOil & Gas Storage & TransportationTulsa, Oklahoma1975-03-310000107263
WLTW
Willis Towers WatsonreportsFinancialsInsurance BrokersLondon, United Kingdom2016-01-050001140536
WYNN
Wynn Resorts LtdreportsConsumer DiscretionaryCasinos & GamingParadise, Nevada2008-11-140001174922
XEL
Xcel Energy IncreportsUtilitiesMulti-UtilitiesMinneapolis, Minnesota00000729031909
XRX
XeroxreportsInformation TechnologyTechnology Hardware, Storage & PeripheralsNorwalk, Connecticut00001087721906
XLNX
XilinxreportsInformation TechnologySemiconductorsSan Jose, California1999-11-080000743988
XYL
Xylem Inc.reportsIndustrialsIndustrial MachineryWhite Plains, New York2011-11-0100015244722011
YUM
Yum! Brands IncreportsConsumer DiscretionaryRestaurantsLouisville, Kentucky1997-10-060001041061
ZBRA
Zebra TechnologiesreportsInformation TechnologyElectronic Equipment & InstrumentsLincolnshire, Illinois2019-12-230000877212
1969
ZBH
Zimmer Biomet HoldingsreportsHealth CareHealth Care EquipmentWarsaw, Indiana2001-08-070001136869
ZION
Zions BancorpreportsFinancialsRegional BanksSalt Lake City, Utah2001-06-220000109380
ZTS
ZoetisreportsHealth CarePharmaceuticalsFlorham Park, New Jersey2013-06-2100015552801952

Summary

Python is probably the best choice for web scrapping. It has many powerful libraries that does all the hard work of web scrapping. Request library helps in getting content of web page into python and Beautiful Soup library helps you to navigate, search and extract required contents from web page. Even a novice can use Python for web scrapping.

Request

Please provide your feedback in comments section. Also, please feel free to contact us in case of any doubt or difficulty. You can contact us.

6 thoughts on “Web Scraping using Python: Tutorial on how to extract data from website using Python”

  1. I just could not depart your website prior to suggesting that I actually enjoyed the standard information a person provide for your visitors? Is gonna be back often in order to check up on new posts

Leave a Reply

Your email address will not be published. Required fields are marked *