0
$\begingroup$

Context:

I'm making a small script to screen through thousands of companies at scale. A feature that I want to include would be relative metrics, e.g. is this company growing faster than its peers, has better margins, and so on.

I can find the sector and industry in various databases, but it's not always very accurate. For example on Yahoo Finance:

  • MSFT: Technology, Software—Infrastructure
  • AAPL: Technology, Consumer Electronics
  • GOOG: Communication Services, Internet Content & Information
  • FB: Communication Services, Internet Content & Information
  • AMZN: Consumer Cyclical, Internet Retail

While these classifications are true, I'd probably group these companies together.

Google autocomplete would often match my intuition better. For example, it gives me:

  • MSFT vs Apple
  • GOOG vs Microsoft

Question:

How can I identify peers of companies at scale? For example:

  • Does some database for this exist?
  • Can I get google autocompletes at scale and map these somehow easily to companies?
  • Or is there some other clever way to find these?
$\endgroup$
3
  • 1
    $\begingroup$ "How can I identify peers of companies at scale?" - clustering? $\endgroup$
    – user42108
    May 4 at 14:47
  • $\begingroup$ What would you use as the main features for such clustering? $\endgroup$
    – ppt
    May 4 at 16:00
  • 1
    $\begingroup$ You mentioned in your original post, "relative metrics, e.g. is this company growing faster than its peers, has better margins, and so on", so presumably you have some in mind..? This is not a new idea, see for e.g. towardsdatascience.com/… $\endgroup$
    – user42108
    May 5 at 17:12
1
$\begingroup$

I don’t know what “at scale” means, but it sound like GIC or SIC code is what you’re looking for. I think GIC is proprietary since it’s from MSCI, but SIC can be found on the EDGAR database.

https://www.sec.gov/info/edgar/siccodes.htm

Edit: To be clearer, using SIC codes gives you the flexibility to construct your own industries. Check out the Kenneth R. French data library as an example. The 12 industry portfolio groups GOOG, AAPL, and MSFT under “BusEq”. That is why I think SIC codes are what you’re looking for. It starts with using the SEC/EDGAR database as a resource.

$\endgroup$
2
  • 1
    $\begingroup$ My impression was the OP disagrees with the standard industry classifications ("I can find the sector and industry in various databases, but it's not always very accurate") hence the question. $\endgroup$
    – user42108
    May 7 at 12:58
  • $\begingroup$ Yes, the question was how to scrape "People Also Watch" section on Yahoo Finance. $\endgroup$ May 7 at 17:46

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.