Measuring neighbourhood-level perceived residential environment quality (PREQ) from multi-platform user-generated text: An LLM-enhanced framework
Qiyuan Hong, Huimin Zhao, Yong Jiang, Cheng Cheng, Ying Long
Habitat International, 176, 103944
Perceived residential environment quality (PREQ) is used to evaluate neighbourhood liveability, yet survey- based instruments are costly and difficult to update at scale. We propose an LLM-enhanced, PREQ-compatible pipeline to measure neighbourhood perceptions from multi-platform Chinese user-generated text. We analyse 2023-2024 texts from three complementary sources: online reviews, social media posts, and citizen complaints. GPT-4o is prompted to filter PREQ-relevant content, extract evaluation object-content pairs, and score sentiment intensity on a five-point ordinal scale from strongly negative to strongly positive. We compare zero-shot and few- shot prompting with supervised fine-tuning, and benchmark all configurations against two baselines: rule-based dictionary matching and BERT. The fine-tuned model performs best (90.0% object-content extraction accuracy; 92.5% sentiment accuracy), outperforming BERT by 66.6 and 4.5 percentage points, respectively. These outputs support a 45-indicator system mapped to the canonical four-aspect, eleven-scale PREQ framework, with data- driven weights combining mention frequency and sentiment intensity. Nationwide results show a negative- leaning sentiment distribution, with the most salient themes concentrated on environmental health, upkeep and care, and the organisation/accessibility of space, alongside platform-specific emphases. Comparing text salience with an urban-renewal literature corpus reveals attention gaps, especially for operational and man - agement issues. A Beijing case study (2038 communities within the Fourth Ring Road) yields an average PREQ score of 3.40/5, lower in the historic core, and shows a statistically significant but weak positive association with survey-based PREQ, alongside weak correspondence with an objective residential environment index. The framework offers a scalable, resident-centred complement to surveys and objective metrics for neighbourhood diagnostics and renewal prioritisation.
