Spatio-Temporal Variation of Conversational Utterances on Twitter

Abstract

Conversations reflect the existing norms of a language. Previously, we found that utterance lengths in English fictional conversations in books and movies have shortened over a period of 200 years. In this work, we show that this shortening occurs even for a brief period of 3 years (September 2009–December 2012) using 229 million utterances from Twitter. Furthermore, the subset of geographically-tagged tweets from the United States show an inverse proportion between utterance lengths and the state-level percentage of the Black population. We argue that shortening of utterances can be explained by the increasing usage of jargon including coined words.

About the Authors:

Christian M. Alis

Affiliation: National Institute of Physics, University of the Philippines, Diliman, Quezon City, Philippines

May T. Lim

* E-mail: [email protected]

Affiliation: National Institute of Physics, University of the Philippines, Diliman, Quezon City, Philippines

Introduction

Utterances, the speaking turns in a conversation, relay short bits of information. Though utterances adapt strongly to medium [1], utterance shortening has been observed over a span of two centuries. Here we show that utterances in the online social medium Twitter did not only significantly shorten in a span of a few years but also varied geographically–providing evidence of increasing usage of jargon brought about by formation of groups. Our use of Twitter conversations provided us with a large, highly resolved and current dataset.

Twitter (twitter.com) is an online social medium that allows its users to post messages (tweets) of up to 140 characters in length, which are public by default. Previous studies [2], [3] on Twitter conversations focused on modelling the structure of conversations rather than the form of utterances. Recent studies have ranged from characterizing the graph of the Twitter social network [4], [5] to inferring the mood of the population [6]–[9]. Owing to the large number of Twitter users (about half-billion in June 2012 [10]) and easy access via the provided application programming interfaces (API), Twitter has become a platform for studying the usage of the English language. For example, it has been found that longer Twitter messages (tweets) are more likely to be credible [11] and, by determining where tweets were posted, dialects [12] and geographical diffusion of new words [13] are observable.

Conversations in Twitter are typically performed in one of two ways: privately, using direct messages; or publicly, using replies. Replies [14] are tweets that begin with the username of the recipient prefixed with an at (@) sign, for example, @bob Hello! How are you?. Since replies may be viewed by other users aside from the recipient, replies are used for public conversations [15] akin to having conversations while other people are listening.

Conversation analysis usually investigates the structure of conversations [16] by looking at the interaction of utterances instead of the individual utterances themselves. Since we are more interested with the encoding of information or idea into an utterance, this paper focused instead on the construction of individual utterances and not in their interaction. More specifically, the length of utterances are measured because the production time and the amount of information of an utterance should be correlated with its length.

Sentence lengths are not as widely studied as words, and conversational utterances less so. The study of sentence lengths began with the work of Udny Yule [17] in 1939 and eventually led to the discovery that sentence length distributions may be approximated by a gamma distribution [18]. On the other hand, the mean length of utterance is used to evaluate the level of language development of children [19], [20]. The length of sentences and utterances are usually measured in terms of words or morphemes but we used the number of characters (orthographic length) as unit of length because Twitter imposes a maximum tweet length in terms of characters. The use of orthographic length of sentences has previously been shown to be a valid unit when comparing utterance length distributions [1]. Furthermore, the orthographic length of words is highly correlated with word length in terms of syllables [21].

In this paper, 229 million conversational utterances collected from 18 September 2009 to 14 December 2012 are first characterized. By comparing expected (fitted) and empirical utterance length distributions, we show that the character limit of tweets has little to no effect on the median utterance length. We also identify some factors that significantly affect the utterance length. The dataset is then disaggregated to reveal that utterances shortened in a span of more than three years. Possible mechanisms of shortening are then explored. Finally, the variation of utterance length across different US states and its correlation with demographic and socioeconomic variables are investigated.

Results

Aggregate Utterance Length Distribution

The utterance length distribution (ULD) of the entire data set (Fig. 1A) is bimodal and can be fitted with a gamma distribution after taking the 140-character limit into account [1]. It is bimodal due to the mixture of the natural (unconstrained) ULD and shortened (constrained) ULD forced by the 140-character limit. To estimate the unconstrained ULD, a generalized gamma distribution,

[Figure omitted. See PDF.]

Figure 1. Utterance length distribution of the entire dataset.

A. Unfiltered utterance length distribution of the entire dataset B. Utterance length distribution of English tweets with URLs and LOL removed. The solid line in both plots is the best fit of Eq. (1).

https://doi.org/10.1371/journal.pone.0077793.g001

(1)where is the utterance length, is the scaled utterance length, and , and are fitting parameters that describe the shape, translation and ordinate scaling factor, respectively, was fitted on the utterance length distribution from char. to a cut-off length using least squares as was done in Ref. [1]. The estimated natural ULD (, char., char.) fits the empirical ULD with an .

Both empirical and fitted (unconstrained) ULD are skewed to the right and the quartiles (Q1 = 25th percentile; Q2 = median = 50th percentile; Q3 = 75th percentile) are either the same (Q1 = 19 char., Q2 = 36 char.) or differs by 3 characters (Q3 char., Q3 char.). From here on, we used the quartiles of the empirical ULD to describe the distributions.

Starting 10 October 2011, all URLs in tweets are automatically shortened by Twitter [22] into a 20-character URL (http://t.co/xxxxxxxx) and this caused the spike at char. in the ULD. The spike at char. is due to non-English tweets while the spike at char. is due to the acronym LOL (laughing out loud). Restricting utterances to English and removing URLs and LOL result to a smoother ULD (Fig. 1B) but with the same quartiles as the original distribution.

Temporal Dependence of Utterance Lengths

Utterance length distributions for tweets aggregated over a 24-hour period that were sampled during Fridays follow the general characteristics of the utterance length distribution for the entire dataset as shown by the representative utterance length distributions in Fig. 2. The right peak of the plots seems to get smaller and shifted to the left as the date becomes more recent, suggesting shortening of utterances over time. This shortening is clearly shown when the quartiles are plotted with respect to time (Fig. 3A). The quartiles roughly follow their corresponding regression line except for 26 Nov 2010, which shows an unexpected spike due to spam.

[Figure omitted. See PDF.]

Figure 2. Representative utterance length distributions per year.

Utterance length distribution of every first available Friday of December in the dataset.

https://doi.org/10.1371/journal.pone.0077793.g002

[Figure omitted. See PDF.]

Figure 3. Utterance length distribution over time.

First quartile Q1 (square), median Q2 (circle) and third quartile Q3 (triangle) of the A. original dataset, B. after resampling into utterances per day, C. removing URLs and D. restricting to English tweets.

https://doi.org/10.1371/journal.pone.0077793.g003

As expected the linear regression line of the median (2nd quartile) is not at the middle of Q1 and Q3 regression lines because the utterance length distributions are skewed. The regression line of Q1 (Table 1 and Fig. 4, all) is less steep than the regression line for the median, which, in turn, is less steep than the regression line for Q3. The shortening of utterances is, therefore, mostly due to the decreased occurrence of longer utterance lengths rather than the shifting of the whole utterance length distributions to the left.

[Figure omitted. See PDF.]

Figure 4. Slopes of utterance length quartiles temporal regression lines.

Visualization of Table 1.

https://doi.org/10.1371/journal.pone.0077793.g004

[Figure omitted. See PDF.]

Table 1. Slopes of utterance length quartiles temporal regression lines.

https://doi.org/10.1371/journal.pone.0077793.t001

Table 1 and Fig. 4 demonstrate the robustness of the decrease in utterance length. The months included in the dataset differ for each year yet shortening is still observed even if only utterances from the common included months of September to December are considered (Table 1 and Fig. 4, Sep–Dec). Similarly, the number of utterances per day and the percent of public data collected are not constant throughout the entire dataset. To remove any size effects on the results, utterances, an amount slightly smaller than the smallest daily sample size, were sampled without replacement for each day (Fig. 3B) but the same observations remained (Table 1 and Fig. 4, resampled). Another possible reason for the shortening is the increased usage of link shorteners. However, the shortening trend (Table 1 and Fig. 4, URLs removed) persisted even if all links in the utterances were removed (Fig. 3C). Finally, restricting the analysis to only English tweets (Fig. 3D) resulted to the same observations (Table 1 and Fig. 4, English only).

Possible Mechanisms for Shortening

A possible mechanism for utterance length shortening is the shortening of the most frequent words either by a change in orthography (spelling) of the most frequent words or their replacement by shorter words.

The median word length of all words is 4 characters (Fig. 5A) for all years from 2009 to 2012. Although the median length of the 1000 most frequently used words from 2009 to 2012 is constant at 4 characters (Fig. 5B), the peak (mode) moved from 4 characters in 2009 to 3 characters (Fig. 5C) in the succeeding years. Based on Kruskal-Wallis tests, the word length distributions of the 1000 most frequently used words for 2010–2012 are not significantly different (, ) with each other but are significantly different with the distribution for 2009 (, ). However, the observed shortening is not just due to a sudden shortening of the 1000 most frequently occurring words from 2009 to 2010 because it was still observed in 2010–2012 (Table 1 and Fig. 4, 2010–2012).

[Figure omitted. See PDF.]

Figure 5. Exploring possible mechanisms of shortening.

Annual values of A. median word length of all words, B. median word length of the 1000 most frequently occurring words, C. most frequent word length of the 1000 most frequently occurring words, D. fraction of 1000 most frequently occurring words relatively to all occurrences of words, E. median utterance length in number of words F. median tweet length in number of words, and G. median trending topic phrase length.

https://doi.org/10.1371/journal.pone.0077793.g005

From % in 2009, the relative occurrence of the 1000 most frequently used words (Fig. 5D) with respect to all words decreased to % in 2012. In that same timespan, the median utterance length in words decreased from 8 words to 5 words (Fig. 5E) while the median tweet length in words (Fig. 5F) decreased from 10 words to 8 words.

A topic is a word, usually in the form of #topic, or a phrase that is contained in a tweet. Trending topics are the most prominent topics being talked about in Twitter within a period of time. The shortening of trending topics could potentially explain the observed shortening of utterances but instead of decreasing, the median length of trending topics increased from 11 characters in 2009 to 13 characters in 2012 (Fig. 5G). Utterances about a trending topic are shortening but the -values (Table 1 and Fig. 4, trending topics) are too small to cause the observed shortening of utterances.

The shortening of utterances is a global phenomenon and is not restricted to the US since utterances that were geolocated outside the US also exhibited shortening (Table 1 and Fig. 4, outside US). It was previously observed in utterances from movies and books [1] albeit at a rate 1 and 3 orders of magnitude smaller (−0.266 char./year in books; −0.001897 char./year in movies), respectively. Although conversations do tend to get shorter in time, our current findings show that it is occurring faster now on Twitter.

Geographical Variation of Utterance Lengths

Out of the 229 million utterances, only 795,048 utterances (0.347%) have geographic information pointing to one of the US states (utterances-byloc.txt in SI). The number of geolocated utterances per US state is strongly correlated () with the 2010 census population of the US state and ranges from 396 utterances in Wyoming to 96,120 utterances in California. The medians are not correlated with the number of utterances () although resampling to 300 utterances, a slightly smaller number of tweets than the smallest sample size, resulted to changes in the quartiles, unlike in the previous section where resampling did not change the quartiles for almost all days after resampling.

To estimate how the quartiles change, the quartiles were bootstrapped using repetitions but the bootstrapped values (Fig. 6A) turned out to be the same as the empirical values. The spread in the bootstrapped medians is very small that the interquartile range (IQR = Q3-Q1) of 40% of the bootstrapped medians is zero. Any difference, therefore, in the median between two US states is almost guaranteed to be significant. Both Kruskal-Wallis H-test (, ) [23] and pairwise Mann-Whitney U-test [24] on the empirical ULD of each US state conclude that not all ULD of the US states are the same.

[Figure omitted. See PDF.]

Figure 6. Utterance lengths across US states.

A. Box plot of the utterance length distribution of each US state sorted by increasing median utterance length. The notches were estimated using 10,000 bootstrap repetitions but the resulting bootstrapped median values are the same as the empirical median values B. Contiguous US states colored with the bootstrapped median utterance length.

https://doi.org/10.1371/journal.pone.0077793.g006

Plotting the medians over a US map (Fig. 6B) suggests southeastern and eastern US states tend to have shorter utterance lengths. This clustering of neighboring US states is very tenous, however, since pairwise Mann-Whitney U-tests on the median utterance length of each US state yielded non-neighboring US state pairings.

To check for possible correlates, the bootstrapped median utterance length was regressed with demographic and socioeconomic information available in the United States Census Bureau State and Country QuickFacts [25] (Table 2). Out of the 51 variables (listed in SI Text S1), only the percent Black resident population (latest data from 2011, ) and percent Black-owned firms (latest data from 2007, ) have . A detailed description of both variables are in SI Text S1. The two variables are strongly correlated though () so the correlation of the bootstrapped median is really with the percentage distribution of Black residents. The bootstrapped median is inversely proportional to the Black resident population (Fig. 7A). Restricting utterances to English and removing URLs improved the correlation to .

[Figure omitted. See PDF.]

Figure 7. Median utterance length against demographic and socioeconomic variables.

The bootstrapped median utterance length plotted against A. 2011 resident Black population in percent (), B. persons 25 years and over who are high school graduates or higher from 2007 to 2011, in percent () and C. Median household income from 2007 to 2011 in thousands of dollars (). The linear regression line is also shown in each plot.

https://doi.org/10.1371/journal.pone.0077793.g007

[Figure omitted. See PDF.]

Table 2. Single-variable linear regression of median utterance length with selected US Census Bureau QuickFacts variables.

https://doi.org/10.1371/journal.pone.0077793.t002

For comparison, the median utterance length was also plotted against the percent of persons 25 years and over who are high school graduates or higher from 2007 to 2011 (Fig. 7B) and median household income from 2007 to 2011 in thousands of dollars (Fig. 7C), which are both described in detail in SI Text S1. Both variables are uncorrelated or only slightly correlated, at best, with the median utterance length because the values of the coefficient of determination are and , respectively.

Multivariate Regression of Median Utterance Length

We explored the possible dependence of the median utterance length on several variables by considering linear combinations of the QuickFacts variables. To ease the comparison of variable effect size and to avoid numerical problems, the variables were standardized by subtracting the sample mean for the variable then dividing by the sample standard deviation for the variable. That is, the -scores of the variables were considered in the multiple regression. Aside from standardization, no other transformation e.g., power transformation, was performed on the variables.

The parameter estimates of the linear model (Model 2) with percent Black resident population , percent high school graduates , and median household income as predictors are shown in Table 3. Only the coefficient for is significantly different from zero and its magnitude is 5 to 10 times larger than the coefficients for and . Further supported by an F-test (, df = 2, , ), the three-variable model can be simplified into the one-variable model.

[Figure omitted. See PDF.]

Table 3. Multiple regression of median utterance length with US Census Bureau QuickFacts variables as possible predictors.

https://doi.org/10.1371/journal.pone.0077793.t003

Performing a stepwise regression () with race, educational attainment and income QuickFacts variables as candidate predictors will yield a two-variable model, Model 3. The variable is still included in the model and the magnitude of its coefficient (−3.30) is about 4.5 times that of the other predictor (0.73), percent of persons 25 years and over who are holders of bachelor’s degree or higher from 2007 to 2011 (denoted as variable ). The value using only as predictor is 0.093. The two-variable model cannot be reduced to a single-variable model with either (, df = 2, , ) or (, df = 2, , ) as the only predictor. The two-variable model improved by 0.03 or 4.3% from that of the single-variable model with as the only predictor.

Expanding the set of candidate variables to all QuickFacts variables then performing another stepwise regression () results to a five-variable model, Model 4. Both variables and are included in the model with still having the largest coefficient magnitude. By adding three more predictors to Model 3, increased by 0.121 or 16.9%. The adjusted of Model 4 is larger by 0.114 or 16.2% than the two-variable model and, since the latter is not equivalent to the former (, df = 3, , ), the former can be considered as a better model despite having more predictors. Model 4 suggests that shorter utterances are correlated with US states having larger percentage of Blacks and lower percentage of bachelor’s degree holders but has more owner-owned houses, larger manufacturing output and less dense population.

The values of QuickFacts variables are regularly updated by the US Census Bureau and only the most recent values are retained. By looking up each variable in the source dataset, one can reconstruct the QuickFacts for previous years (up to 2010). Repeating the regression analysis for the different models using the data for previous years resulted to coefficient estimates that are within the standard errors of the quoted variables above. Thus, the coefficients remained essentially the same from 2010 to 2012.

Discussion

The observation of geographic variability is not entirely unexpected because of the existence of dialects. What is more surprising is that the utterance length is (anti)correlated with the resident Black population. This factor also dominates other predictors when combined with other demographic and socioeconomic factors using multiple regression. A possible explanation is that Blacks converse more distinctly and more characteristically than other racial groups. Since utterances are only weakly correlated with median income and educational attainment then perhaps the shorter utterance lengths is a characteristic of their race–perhaps pointing towards the controversial language of Ebonics [26]. The strong correlation does not imply causality, and it is beyond the scope of this work to look for actual evidence of Ebonics in the tweets.

Results show that people are communicating with fewer and shorter words. The principles of least effort communications [27] provide us with two possible implications. If the information content of each word remains the same then the information content of each utterance is lesser and more utterances are needed to deliver the same amount of information–a phenomenon that could be verified by tracking the complete conversations between individuals, and not just samples as we are doing now. On the other hand, if the amount of information content of each utterance remains the same then encoding becomes either more efficient (comprehension remains the same) or more ambiguous through time. When ambiguity increases, speaker effort is minimized at the expense of listener effort.

Based on anecdotal evidence, replies broken into several tweets are not more frequent than before but shorter spelling and omission of words do seem to be more prevalent. That is, encoding appears to become more efficient without sacrificing as much precision.

The shortening, it seems, can be explained by increased usage of jargon, which in turn provides evidence of segregation into groups. People who are engaged in a conversation communicate using a shared context, which may utilize a more specialized lexicon (jargon or even coined words). Although utterances are expected to be less clear due to the use of fewer words, the use of context prevents this from happening. The decrease in the frequency of words from 60.32% to 52.8% could mean that the use of jargon increased by about 60.32%−52.8% = 7.52%. Furthermore, one of these groups might be composed of African Americans hence the dependence on percent Black population can be readily explained. Since no other demographic or socioeconomic variable is correlated with utterance length then these groupings cannot be entirely demographic or socioeconomic in nature.

There is no obvious remaining factor that could bias the temporal analysis of utterance lengths after the shortening was shown to be robust. There are several approaches in determining the proper location of users from tweets [12], [28] but we used the simplest method of assigning the location of the user to the location of the tweet. The geolocated tweets are relatively few and the tweets (users) were then aggregated by US state. Statistical data from the US Census Bureau were then used in the analysis. The inherent assumption, therefore, is that the sample used by the Bureau can also be used to describe the sample of Twitter users. A survey done by Smith and Brenner [29], however, showed that among the different races, Blacks significantly use Twitter more than other races. This could be the reason why only the dependence on Black population was observed. More data are needed to verify if our assumption is justified but our results are tantalizing enough to warrant a second look.

Materials and Methods

Tweets were first retrieved using the Twitter streaming application programming interface [30] and corresponds to 15% (before August 2010), 10% (between August 2010 to mid-2012) or 1% (mid-2012 to present) of the total public tweets. For ease of computation, we analyzed only tweets posted every Friday from 18 September 2009 to 14 December 2012. Although issues in our retrieval process prevented us from getting the entire sampled feed for the entire data collection period, only Fridays with uninterrupted and complete data were considered resulting to a total of 124 days analyzed. Conversational utterances in the form of replies were selected by filtering for tweets that begin with an at sign (@), which yielded 229 million utterances (utterances-bydate.txt in SI).

The utterance length of a tweet was measured by first stripping off all leading @usernames with the python regular expression ((^∧|\ s)*@\ w+?\ b)+. The utterance length is the number of remaining characters after leading and trailing whitespace characters were removed. Utterances having lengths equal to zero (0.483%) and greater than the maximum length of 140 char. (0.0935%) were excluded from the dataset.

Tweet language identification was performed using langid.py [31], which claims 88.6% to 94.1% accuracy when identifying the language of a tweet over 97 languages. ldig [32] stands to be the most accurate automated language identification system for tweets having a claim of 99% accuracy over 19 languages ( accuracy for English), however, it has not yet been formally subjected to peer review. Nevertheless, we repeated the analysis using ldig and found similar results and conclusions.

Tweets were geolocated using the geo and coordinates metadata of the tweets and were categorized by US states using TIGER/Line shapefiles [33] prepared by the US Census Bureau. A user must opt-in to have location information be attached to their tweets. Previously, only exact coordinates (latitude and longitude) are attached as location information and these become the values of the geo and coordinates metadata of the tweet. More recently, users may opt to select less granular location information e.g., neighborhood, city and country, and these less precise place information are now the default. [34] A user, though, may still choose exact location information or omit location information for every tweet. Geolocation is possible with both mobile clients and browsers but geolocation for the latter is not yet available for all countries.

A parallel [35] version of the Space Saving [36] algorithm for selecting the most frequent words was used instead of a naive histogram of word occurrences because of the prohibitive amount of resources needed. The Space Saving algorithm maintains a frequency count of up to words only. An untracked word replaces the least frequent word if the maximum number of words are already being tracked. The parallel Space Saving algorithm involves partitioning the data then running the Space Saving algorithm for each chunk. The results of each chunk are merged using an algorithm similar to Space Saving. The word frequency of both Space Saving and its parallel version are approximate for near--ranked words. To have a guaranteed list of the 1000 most frequently occurring words, a much larger value of was used.

Supporting Information

[Figure omitted. See PDF.]

Dataset S1.

Utterance length frequencies by date. The rows of this comma-separated file correspond to tweets posted on a certain UTC date. The first column is the date in ISO format (yyyy-mm-dd) and the remaining columns list the number of utterances with a length of 1 character, 2 characters, 3 characters and so on, until 139 characters. Only the frequencies of “valid” utterance lengths (1–139 characters) are included.

https://doi.org/10.1371/journal.pone.0077793.s001

(TXT)

Dataset S2.

Utterance length frequencies by US state. The rows of this comma-separated file correspond to tweets posted from a US state. The first column is the abbreviated US state (e.g., AK) and the remaining columns list the number of utterances with a length of 1 character, 2 characters, 3 characters and so on, until 139 characters. Only the frequencies of “valid” utterance lengths (1–139 characters) are included.

https://doi.org/10.1371/journal.pone.0077793.s002

(TXT)

Text S1.

Information on State and County QuickFacts variables.

https://doi.org/10.1371/journal.pone.0077793.s003

(PDF)

Acknowledgments

Some computational resources were provided by the Advanced Science and Technology Institute, Department of Science and Technology, Philippines.

Author Contributions

Conceived and designed the experiments: CMA MTL. Performed the experiments: CMA. Analyzed the data: CMA MTL. Wrote the paper: CMA MTL.

Citation: Alis CM, Lim MT (2013) Spatio-Temporal Variation of Conversational Utterances on Twitter. PLoS ONE 8(10): e77793. https://doi.org/10.1371/journal.pone.0077793

References

1. Alis CM, Lim MT (2012) Adaptation of fictional and online conversations to communication media. The European Physical Journal B 85: 1–7.

2. Ritter A, Cherry C, Dolan B (2010) Unsupervised modeling of Twitter conversations. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Los Angeles, California: Association for Computational Linguistics. pp. 172–180.

3. Kumar R, Mahdian M, McGlohon M (2010) Dynamics of conversations. In: Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining. New York, NY, USA: ACM, KDD ‘10, p. 553–562. doi:10.1145/1835804.1835875.

4. Huberman B, Romero DM, Wu F (2008) Social networks that matter: Twitter under the microscope. First Monday 14. Available: http://journals.uic.edu/ojs/index.php/fm/article/view/2317. Accessed 20 December 2008.

5. Kwak H, Lee C, Park H, Moon S (2010) What is Twitter, a social network or a news media? In: Proceedings of the 19th international conference on World Wide Web. New York, NY, USA: ACM, WWW ‘10, p. 591–600. doi:10.1145/1772690.1772751.

6. Gonçalves B, Perra N, Vespignani A (2011) Modeling users’ activity on twitter networks: Validation of Dunbar’s number. PLoS ONE 6: e22656.

7. Bollen J, Mao H, Zeng X (2011) Twitter mood predicts the stock market. Journal of Computational Science 2: 1–8.

8. Golder SA, Macy MW (2011) Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. Science 333: 1878–1881.

9. Kloumann IM, Danforth CM, Harris KD, Bliss CA, Dodds PS (2012) Positivity of the English language. PLoS ONE 7: e29484.

10. Semiocast (2012). Twitter reaches half a billion accounts - more than 140 millions in the U.S. Available: http://semiocast.com/publications/2012_07_30_Twitter_reaches_half_a_billion_accounts_140m_in_the_US.Accessed 30 July 2012.

11. O’Donovan J, Kang B, Meyer G, Hollerer T, Adalii S (2012) Credibility in context: An analysis of feature distributions in Twitter. In: Privacy, Security, Risk and Trust (PASSAT), 2012 International Conference on and 2012 International Conference on Social Computing (SocialCom). pp. 293–301. doi:10.1109/SocialCom-PASSAT.2012.128.

12. Eisenstein J, O’Connor B, Smith NA, Xing EP (2010) A latent variable model for geographic lexical variation. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing. p. 1277–1287.

13. Eisenstein J, O’Connor B, Smith NA, Xing EP (2012) Mapping the geographical diffusion of new words. In: Proceedings of Social Network and Social Media Analysis: Methods, Models and Applications. Lake Tahoe, Nevada: NIPS.

14. Twitter (2012). What are @replies and mentions? Available: https://support.twitter.com/articles/14023-what-are-replies-and-mentions. Accessed 25 September 2012.

15. Williams E (2008). How @replies work on twitter (and how they might). Available: http://blog.twitter.com/2008/05/how-replies-work-on-twitter-and-how.html. Accessed 25 September 2012.

16. Wooffitt R (2005) Conversation analysis and discourse analysis: a comparative and critical introduction. London: Sage Publications Ltd.

17. Yule GU (1939) On sentence-length as a statistical characteristic of style in prose: with application to two cases of disputed authorship. Biometrika 30: 363–390.

18. Sigurd B, Eeg-Olofsson M, van de Weijer J (2004) Word length, sentence length and frequency - Zipf revisited. Studia Linguistica 58: 37–52 (16)..

19. Klee T, Fitzgerald MD (1985) The relation between grammatical development and mean length of utterance in morphemes. Journal of Child Language 12: 251–269.

20. Dollaghan CA, Campbell TF, Paradise JL, Feldman HM, Janosky JE, et al. (1999) Maternal education and measures of early speech and language. J Speech Lang Hear Res 42: 1432–1443.

21. Strauss U, Grzybek P, Altmann G (2006) Word Length and Word Frequency. In: Grzybek P,editor. Contributions to the Science of Text and Language. Berlin/Heidelberg: Springer-Verlag, Vol. 31: 277–294.

22. Twitter (2012). The t.co URL wrapper. Available: https://dev.twitter.com/docs/tco-url-wrapper. Accessed 14 January 2013.

23. Kruskal WH, Wallis WA (1952) Use of ranks in one-criterion variance analysis. Journal of the American Statistical Association 47: 583.

24. Mann HB, Whitney DR (1947) On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat 18: 50–60.

25. United States Census Bureau (2013) State and County QuickFacts. Washington: Government Printing Office.

26. Collins J (1999) The Ebonics controversy in context: literacies, subjectivities, and language idelogies in the united states. In: Blommaert J, editor, Language Ideological Debates, Walter de Gruyter.

27. Cancho RFi, Solé RV (2003) Least effort and the origins of scaling in human language. Proceedings of the National Academy of Sciences of the United States of America 100: 788–791.

28. Mocanu D, Baronchelli A, Perra N, Gonçalves B, Zhang Q, et al. (2013) The Twitter of Babel: Mapping world languages through microblogging platforms. PLoS ONE 8: e61981.

29. Smith A, Brenner J (2012) Twitter use. Technical report, Pew Internet & American Life Project. Available http://pewinternet.org/Reports/2012/Twitter-Use-2012/Findings.aspx. Accessed 31 May 2012.

30. Kalucki J (2010). Streaming API documentation. Available: http://apiwiki.twitter.com/w/page/22554673/Streaming-API-Documentation?rev=1268351420. Accessed 15 April 2011.

31. Lui M, Baldwin T (2012) langid.py: An off-the-shelf language identification tool. In: Proceedings of the ACL 2012 System Demonstrations. Jeju Island, Korea: Association for Computational Linguistics, 25|30.

32. Nakatani S (2012). Short text language detection with infinity-gram. Available: http://shuyo.wordpress.com/2012/05/17/short-text-language-detection-with-infinity-gram/. 30 December 2012.

33. United States Census Bureau (2012). 2012 TIGER/Line shapefiles [machine-readable data files].

34. Twitter (2013). FAQs about tweet location. Available: https://support.twitter.com/articles/78525-about-the-tweet-location-feature. Accessed: 24 January 2013.

35. Cafaro M, Tempesta P (2011) Finding frequent items in parallel. Concurrency and Computation: Practice and Experience 23: 1774–1788.

36. Metwally A, Agrawal D, Abbadi AE (2005) Efficient computation of frequent and top-k elements in data streams. In: Eiter T, Libkin L, editors. Database Theory - ICDT 2005. Lecture Notes in Computer Science. Springer Berlin Heidelberg. pp. 398–412.