Skip to content

Latest commit

 

History

History
61 lines (42 loc) · 2.58 KB

README.md

File metadata and controls

61 lines (42 loc) · 2.58 KB

TPS -- Turkey Positioning System

TPS, detects city-level locations of tweets that were collected via Twitter API v1 and v2

Works for Turkish cities only with the default data from src/data. Can be modified for other countries as well.

First, gather the necessary files via class GatherFiles. Then, conduct the search. A sample run can be found in main.py. 2 examples are given in folder examples_and_figs, their codes are given in src/examples.py.

Locations searched in order to map the tweet to a city:

  • City name
  • "Ilçe" name (smaller part of a city)
  • "Semt" name (smaller part of an ilçe)

Usage

One can use this tool via downloading the repository and running main.py. main.py and src/ are the main contents needed for usage.

Features

Population bias:

  • Active: If a district name is included in multiple cities, estimate that the tweet is from the city with the larger population. pop_bias parameter is set to False by default.
  • Inactive: Do not do this

Retweets:

  • It can either filter out or keep retweets during the search

User or tweet based:

  • It can either find locations of users or tweets.
  • For users, say that the user has 10 tweets, the system maps all the tweets to a city if possible. Then, the user is mapped to the city on which the user has most tweets in.

Keyword search:

  • It can filter out tweets such that they need to include a specific phrase in their tweet text. This can be, for example, a popular username.

Date window:

  • It can search for tweets coming from a specific time window.
  • Examples: [[2023,10,7], 15]. From the specified date (Y/M/D), go +- 15 days. That is the interval.

Priority queue:

  • It can search for specific location metadata, by the given order.
  • Available location metadata:
    • V1

      • user_bio: ["user"]["location"]
      • tweet: ["place"]["full_name"]
      • coordinates: ["geo"]
    • V2

      • user_bio: ["includes"]["users"][0]["location"]
      • tweet: ["includes"]["places"][0]["full_name"]

References

Links for the sources that contents in src/data/ were obtained.

cities.txt: https://engelsizdestek.org/iller

city_mapper.xlsx: https://postakodu.ptt.gov.tr/

populations.json: https://gist.github.com/ozdemirburak/4821a26db048cc0972c1beee48a408de. The populations here are updated from yillara-gore-il-nufuslari.xls

yillara-gore-il-nufuslari.xls: https://data.tuik.gov.tr/Bulten/Index?p=49685. Populations for the year 2022 were used.

data/turkey.geojson --> https://github.com/alpers/Turkey-Maps-GeoJSON