Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data-mining]

The tag has no usage guidance.

0
votes
0answers
33 views

Why does an increase in eviction court filings result in an increase in REIT returns?

I'm a data mining developer working for a company that wholesales eviction record data on a national level. I was recently assigned a project to build a program to mine all county courts in Oklahoma ...
0
votes
1answer
74 views

unsupervised pattern discovery - methods?

Given that I select features manually, what methods are available for pattern discovery with the purpose of time series prediction (footnote)? I only stumbled upon hierarchical clustring ("bottom-up"...
0
votes
0answers
107 views

Any databases with CEO letters and shareholder letters?

I am researching disclosures on CEO letters and Shareholder letters present in annual reports of listed companies in the London Stock Exchange. Can someone recommend a database where the annual ...
1
vote
3answers
1k views

How to convert weekly data to monthly in r (or in Julia)

I have weekly series on financial risk index data as follows: DATE NFCIRISK 1/8/1971 0.58 1/15/1971 0.61 ......through 10/6/2017 -0.88 10/13/2017 -0.89 10/20/2017 -0.89 ...
8
votes
3answers
1k views

Determine trends of data (direction detection or turning point detection)

I'm working on a model to determine trends (direction detection or turning point detection). Suppose that we have a stock trend which is illustrated below. Blue line is real trend of stock close ...
0
votes
0answers
34 views

How to analyze transaction vs money

I have a computer science and AI background. Recently I struggled to find patterns in a banking dataset. The first thought was that I should plot the graph of the number of transaction of each ...
1
vote
0answers
1k views

Map CUSIP to CIK

I'm trying to analyse 13F filings and those provide CUSIPs and names. I hoped the names would be sufficient to find the relevant Edgar filings but the names are often imprecise (e.g., "ABBOTT LABS" ...
0
votes
1answer
99 views

Markov chain downgrades in loan book modelling

I am working on a personal loan dataset. For each loan, we recorded its credit status monthly after it was drawn by the borrower. Let's say there were 6 status coded by A-F. My project is to use ...
2
votes
2answers
307 views

Data mining of financial time series and pattern discovery - beyond technical analysis?

There are lot of works about pattern discovery in financial time series - but all of them (known to me) are connected with technical analysis and that is field (as said by many) that is not rigorous ...
2
votes
1answer
51 views

Free Data Sets for VaR calculations

I am trying to do some work on VaR and Expected Shortfall with the help of Generalized Pareto Distributions. Can someone please guide me to some dataset of financial data, preferably something like a ...
1
vote
0answers
33 views

Feedback on Video Metadata Extraction

I've developed/patented a metadata extraction methodology, which we've used to build a variety of alternative datasets for funds. One of the more difficult issues in this field, is getting useful ...
0
votes
0answers
160 views

How to use Chow Lin method?

Can someone give me a simple explanation of how exactly this method works. If I have a dataset of say 10 quarters (dependent variable); how should the independent variable (say monthly data) be ...
2
votes
1answer
203 views

White's Reality Check versus Benjamini-Hochberg-Yekutielie Procedure

I'm backtesting about 1k different strategies / permutations of strategies and I want to identify which if any of the strategies are better than the benchmark. Based on my readings, I feel like I've ...
0
votes
1answer
276 views

list of ADR's by volume or market cap

I'm looking for a list of ADR's (for a simulation) that I can screen by either market cap or volume? If anyone knows of a free way to get such a list it would be much appreciated.
0
votes
1answer
4k views

Is there a piratebay for data(bases)? (here, talking about historical financial data) [closed]

I would like to, for example, access (and later, upload), for example, historical financial data for the S&P500. If a piratebay for databases existed, maybe we could freely share information that ...
7
votes
1answer
681 views

How to better understand trading signals?

I am looking to get a better understanding of an output from a trading strategy. Basically I have a daily equity curve lets call it $Y_t$. I have defined a bunch of independent variables $X_{it}$ that ...
12
votes
0answers
521 views

Can we use White's reality check to compare two Sharpe ratios?

I read a paper from Ledoit and Wolf that proposes a method to compare two Sharpe ratios and a paper from White that proposes a method to compare $n$ trading rules. My question is: Can we use White's ...
43
votes
6answers
7k views

Which approach dominates? Mathematical modeling or data mining?

According to my current understanding, there is a clear difference between data mining and mathematical modeling. Data mining methods treat systems (e.g., financial markets) as a "black box". The ...
15
votes
4answers
2k views

How to encode trading strategies mathematically

If you have a bunch of different econometric data (e.g. indexes, FX, commodities, interest rates...) you can try to find a formula to see if there is any relationship in the data - e.g. to forecast ...