Corpus do Português contains about one billion words of data in web pages from four different Portuguese-speaking countries (Brazil, Portugal, Angola, Mozambique). This corpus allows you to look at very recent Portuguese (the texts were collected 2013-14), and to compare among the different dialects.
The new corpus is also much larger than the previous corpus — more than 50 times as large for Modern Portuguese (one billion words, compared to just 20 million words from the 1900s in the original corpus). So where you might have 20-25 tokens with the original corpus, you might have 1,000 or more with the new corpus.
Note: The license stipulates that the data is primarily intended for use in research, not teaching. Faculty and graduate students may request access to the data for their research. Undergraduate students may not have access. If you need corpus data for undergraduate classes, please use the standard web interface for the corpora.
- In no case can substantial amounts of the full-text data (typically, a total of 50,000 words or more) be distributed outside the organization listed on the license agreement. For example, you cannot create a large word list or set of n-grams, and then distribute this to others, and you could not copy 70,000 words from different texts and then place this on a website where users from outside your organization would have access to the data.
- The data cannot be placed on a network (including the Internet), unless access to the data is limited (via restricted login, password, etc) just to those from the organization listed on the license agreement. For example, it cannot be placed on another corpus site, which indexes the data and then makes it available to end users, because that other corpus site would then have access to the data.
- In addition to the full-text data itself, #2 also applies to derived frequency, collocates, n-grams, concordance and similar data that is based on the corpus.
- If portions of the derived data is made available to others, it cannot include substantial portions of the the raw frequency of words (e.g. the word occurs 3,403 times in the corpus) or the rank order (e.g. it is the 304th most common words). (Note: it is acceptable to use the frequency data to place words and phrases in “frequency bands”, e.g. words 1-1000, 1001-3000, 3001-10,000, etc. However, there should not be more than about 20 frequency bands in your application.)
- Any publications or products that are based on the data should contain a reference to the source of the data: https://www.corpusdata.org.
- Note that a small, unique change will be made to each set of data, and this will serve as a “fingerprint” to identify you as the unique source of the datasets that you download. Automated Google searches are run daily to find copies of the data on the Web. If we find the data online and it is the data that was sent to you (and we will be able to determine that is the case), then you will be required to contact the administrators for that website, to have the data removed.
Davies, Mark. (2016-) Corpus do Português: Web/Dialects. Available online at http://www.corpusdoportugues.org/web-dial/.
Request access by contacting email@example.com.
Last updated: 24 March 2023