--- title: "Population Location and Movement Estimation through Cross-domain Data Analysis" authors: - "Xinghao Yang" - "Wei Liu" doi: "10.24963/ijcai.2020/736" url: "https://ijcai.org/proceedings/2020/736" pdf: "https://ijcai.org/proceedings/2020/0736.pdf" venue: "Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence" year: 2020 pages: "5192-5193" track: "Doctoral Consortium" keywords: - "Machine Learning: Multi-instance;Multi-label;Multi-view learning" - "Machine Learning: Clustering" - "Data Mining: Clustering, Unsupervised Learning" - "Machine Learning: Tensor and Matrix Methods" --- # Population Location and Movement Estimation through Cross-domain Data Analysis Xinghao Yang, Wei Liu *Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence*, pages 5192-5193. DOI: [10.24963/ijcai.2020/736](https://doi.org/10.24963/ijcai.2020/736) ## Abstract Estimations on people movement behaviour within a country can provide valuable information to government strategic resource plannings. In this paper, we propose to utilize multi-domain statistical data to estimate people movements under the assumption that most population tend to move to areas with similar or better living conditions. We design a Multi-domain Matrix Factorization (MdMF) model to discover the underlying consistency patterns from these cross-domain data and estimate the movement trends using the proposed model. This research can provide important theoretical support to government and agencies in strategic resource planning and investments. ## Full text ## 1 Introductioin In recent years, the rapid population growth and imbalanced population distribution are two main factors that leading to a high population pressure to Australia's major cities, which drives government consider more about: How to estimate people's settlement patterns and movement trends? In this work, we take the New South Wales (NSW) state as an example, aiming to find out the population movement across different Local Government Areas (LGAs). However, the regional internal migration estimates (RIME) data only contains the number of people coming in and out of a region, without clarifying their sources/destinations. So the problem we need to address in this work can be represented in two aspects: The Source. Where were the intake population coming from? The Destination. Where were the outflow population going to? Specifically, we make the following main contributions: (1) We take the advantage of multi-domain data to evaluate the living quality, such as house adverstisement data, economy & industry and crime census data. (2) We propose a Multi-domain Matrix Factorization (MdMF) algorithm, which can simultaneously decomposes N(≥ 3) domain data (see Figure 1). (3) We design a statistical learning models, which estimates the population movement trend by multiplying the consistent clustering result with RIME data. ∗Contact Author Figure 1: Multi-domain Matrix Factorization (MdMF). ![Image](https://ijcai.org/proceedings/2020/fulltext/736/image_000000_c4395dbf6dccabdba0e8b498b4310e3ba0ae2f27bd5c3e14838aea42396859b9.png) ## 2 Methodology The cross-domain data fusion is a key technique in integrating multiple data sources to produce more consistent, accurate, and effective information. For example, [Do et al., 2017] presented a collective matrix factorization method to find latent similarities of two domain data. In this paper, we design the multi-domain matrix factorization (MdMF) to match any more domain data that contains both domain-specific and domain-consistency information. Specifically, suppose we have N(≥ 3) domain data {X(i) ∈ ℜDi×J , i = 1, · · · ,N}, where Di denotes the dimensionality of the ith domain, and J is the number of LGAs, then our MdMF model is: where each X(i) is decomposed into a Di × K matrix U(i) and a K × J matrix [V(0) |V(i) ]T . Specifically, the common part V(0) contains the consistency clustering result, with the element V(0) i,j (red in Figure 1) denotes the probability of the j th LGA belonging to the ith cluster. To achieve efficiency, we optimize each row of U and V rather than performing the optimization on the whole matrix at once. So the updating rule 1 for u(i)T d , v(0) j and v(i) j are: The solution for MdMF is summarized in Algorithm 1. [1 Derivation details can be found in our full draft: https://www. dropbox.com/s/bvil6pnxwgm5zdn/MdMF Full Paper.pdf?dl=0.](https://www.dropbox.com/s/bvil6pnxwgm5zdn/MdMF_Full_Paper.pdf?dl=0) Table 1: The top-2 source and destination LGAs of Western Sydney area. The Numbers in brackets are the amount of population movements. | LGAs | SOURCE - Top-1 | SOURCE - Top-2 | DESTINATION - Top-1 | DESTINATION - Top-2 | |-----------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------| | Blacktown Camden Campbelltown Canterbury-Bankstown Fairfield Liverpool Parramatta Penrith The Hills Shire | Lake Macquarie (1421) Hornsby (319) Newcastle (592) Lake Macquarie (1385) Lake Macquarie (567) Lake Macquarie (849) Sydney (1013) Lake Macquarie (795) Hornsby (942) | Newcastle (1414) Lake Macquarie (279) Lake Macquarie (590) Newcastle (1329) Newcastle (540) Newcastle (843) Hornsby (903) Newcastle (783) Lake Macquarie (662) | Wollongong (664) Hawkesbury (43) Wollongong (235) Lake Macquarie (721) Lake Macquarie (266) Wollongong (285) Lake Macquarie (375) Wollongong (251) Hornsby (237) | Lake Macquarie (599) Wollondilly (43) Lake Macquarie (202) Newcastle (665) Newcastle (243) Lake Macquarie (254) Hornsby (360) Lake Macquarie (232) Ku-ring-gai (222) | | Algorithm 1 Optimization of MdMF model (1) | Algorithm 1 Optimization of MdMF model (1) | |------------------------------------------------|------------------------------------------------------------| | Input: X(i) , and ε Output: U(i) , V(0) , V(i) | Input: X(i) , and ε Output: U(i) , V(0) , V(i) | | 1: | Randomly initialize all factors | | 2: | Initialize L by a small number | | 3: | repeat | | 4: | PreL = L | | 5: | for i = 1 : N do | | 6: | Solve U(i) while fixing all other factor by minimizing (2) | | 7: | end for | | 8: | Solve V(0) while fixing all other factor by minimizing (3) | | 9: | for i = 1 : N do | | 10: | Solve V(i) while fixing all other factor by minimizing (4) | | 11: | end for | | 12: | Compute L following (1) | | 13: | until PreL-L PreL < ε | We then propose a statistic learning strategy to estimate the intra-state population movement. First, we proportionally subtract the amount of inter-state movement from RIME and denote the net intra-state arrival and departure vector as Anet = [Anet 1 . . .Anet J ] and Dnet = [Dnet 1 . . .Dnet J ], respectively. The second step is dividing all the LGAs into two groups, i.e., the 9 Western Sydney LGAs and all the rest LGAs: Finally, the SOURCE and DESTINATION matrices are where the W⊗H denotes the matrix-vector product with each element of the product is Wi,jHj . The SOURCE matrix solves the source problem - the (i, j)th element denotes that there were SOURCEi,j people that moved into the ith Western Sydney LGA from the j th other NSW LGA, and analogously for DESTINATION. ## 3 Experiments and Analysis In this case study we focus on the year of 2015 as the RIME data depends on 2011 zoning criteria. The common clustering parameter C is empirically set to 5. We integrate house price, industry&economy and crime data to estimate living quality. For example, we select 8 features from house price data, such as, dwelling numbers, median sale price, etc. The important thing to note is that the estimated result are all local optima of our overall optimization problem which is not a strictly convex problem and can not guarantee a global optimum. Table 2: The RIME data (top-5 arrival and departure LGAs). | Arrival | Arrival | Departure | Departure | |----------------|-----------|----------------|-------------| | Sydney | 20332 | Sydney | 21713 | | Lake Macquarie | 11685 | Hornsby | 12814 | | Newcastle | 11535 | Randwick | 11713 | | Hornsby | 11461 | Newcastle | 11116 | | Ryde | 9588 | Lake Macquarie | 10680 | The top-2 results of SOURCE and DESTINATION matrices are listed in Table 1. From Table 1 we can see that top-1 source areas are Lake Macquarie, Hornsby, Newcastle and Sydney. This indicates that these four LGAs are the areas with large population outflow, which is consistence with the RIME data (Table 2). The DESTINATION part indicates that the Lake Macquarie and Hornsby are also major migration destinations for people moving out of western Sydney. This may due to that the Lake Macquarie and Hornsby have similar living conditions with the selected LGAs. Interestingly, these four areas are geographically close to western Sydney, which makes the movement more convenient. Additionally, although Sydney ranks the top-1 in RIME arrival, it is not the best destination choice for western Sydney people. This may due to big difference of house median prices, i.e., Sydney being 72% higher than in western Sydney. The estimation results may serve as a good reference for government in making policies or for industries in making investments. In future, we plan to query feedbacks from Sydney government about the people migration estimation results. Besides, working on quantitative analysis and comparative studies with more baseline methods should be potential research directions based on the government motivation. ## References 1. [Do et al., 2017] Quan Do, Wei Liu, and Fang Chen. Dis- covering both explicit and implicit similarities for cross- domain recommendation. In Pacific-Asia Conference on Knowledge Discovery and Data Mining, pages 618-630. Springer, 2017.