Avances Tecnicos - Plataforma Observatorio

De CEDEUS wiki
Saltar a: navegación, buscar

>> volver a Documentos Grupo Trabajo Observatorio


Año 2013

Nov - Dec 2013

Año 2014

Enero - Febrero 2014

  • software evaluation and testing / evaluacion de software y test instalación de GeoNode en mi servidor personal (cedeusgis1) : 6. Ene - 28. Feb:
    1. instalación GeoNode,
    2. instalación y test con BD externa,
    3. test backup GeoNode,
    4. test backup BD,
    5. test anadir tiles/datos in GeoExplorer de TileStream

Marzo - Abril 2014

Mayo - Junio 2014

Julio 2014

  • creating (intermediate) observatory entry webpage in spanish and english
  • setting up reverse proxy to be able to route subdomains to web servers and avoid port filtering problems by the university
    => http://wiki.geosteiniger.cl/mediawiki-1.22.7/index.php/Cedeus_Technical_Architecture
  • working on journal paper with Francisco de la Barrera (Rapid ecological assessment of green spaces using Google Imagery databases : Google Maps and Google Streetview)
  • presentation of work on the CEDEUS observatory at SNIT Conference (www.ide.cl)

Septiembre - Octubre 2014

  • Stefan:
  • Helen:
    • testing of GeoNode and Wiki access and use (got some significant problems dues to PUC/UdeC IP/port filtering and GeoNode user group assignments) / testeo del software
    • first draft of GeoNode user guide / borrador del guia de uso por GeoNode

Noviembre 2014

  • setup of UPS (Un-interruptable Power Supply) / instalacion UPS
  • project work / trabajo en proyecto :
    • georeferenciar datos de contamninacion de buses
    • analisis inicial de datos de contaminacion de aguas - Alejandra / Pablo Pasten
    • trabajo en publicaciones: (a) e-Planning Platform (IJGIS), (b) Datastructures, spatial data over the web (AAG Encyclopedia of Geography), (c) abstract for ICC 2015

Diciembre 2014

  • Stefan:
    • setup of nightly database backups / instalacion proceso de toma de copias de seguridad nocturnos
    • setup of controled server shutdown mechanism in case of power outages and low battery / instalacion de un mecanismo de apago de servidores en caso de cortes de luz
    => documentacion de ambos items es disponible en http://wiki.geosteiniger.cl/mediawiki-1.22.7/index.php/Cedeus_DB_backups
    • data uploads to repository / carga de datos
  • Helen:
    • data upload /caraga de datos: conversatorios - nudos criticos
    • update of GeoNode user guide / revision del guia de uso GeoNode
 With the installation of backup procedures the CEDEUS database is ready for use! /
 Con la instalacion de copias de seguridad la  base de datos CEDEUS es listo para usar!
 http://cedeusdata.geosteiniger.cl

Año 2015

Enero 2015

  • Stefan :
    • data upload OpenStreetMap Chile / subido datos basicos (topograficas) de Chile - derivado de OpenStreetMap.org
    • Plataforma "Participa CEDEUS" - application document for course IIC 2154 / postulacion por proyecto IIC 2154 (with editing by Helen) - pdf
  • Helen (+ Stefan) : spanish user guide finalized / finalizado y publicado "Guía de uso para la Base de Datos" por GeoNode / Base de Datos CEDEUS como documento pdf : vea Guias

Febrero 2015

  • Stefan :
    • (borrador de un) mapa de Chile con contaminacion arsenico de aguas para Pablo Pasten & Alejandras Vega
    • trabajo en publicaciones para ISPRS Journal of Geographic Information (IJGI) como co-autor
    • comenzo una lista de fuente de datos (en ingles): Data Sources
  • Helen:
    • creacion de cuentas para investigadores de grupo de trabajo Observatorio
  • Nikolai:

Marzo 2015

  • Installation of Nominatim, a web-service that can search for adresses and return coordinates, e.g. Av. Holanda 2630, Providencia => x,y
  • Writing scripts to geo-code Chile's traffic accident database (approx. 500'000 accidents since 2000) => this is ongoing work
  • uploading 15+ geographic dataset from Biblioteca Nacional de Chile (BNC) and MOP to web-platform (GeoNode) => we have now 48 georgaphic datasets and another 90+ other datasets
  • poster for CEDEUS conference, to get people to sign up - with Helen: pdf
  • reworking proyect proposal for course IIC 2154 to develop a research(er) information platform (Participa CEDEUS) for the observatory - with Helen => unfortunately the project got not selected for IIC 2154 this term.

Abril 2015

  • writing on script for geo-coding traffic accident database (part II, accident locations given by 2 road names)
  • data search w.r.t. flooding in the North (Copiapo etc): search satellite image data
    • discussion with Nikolai E. on how to map flooding areas
    • downloading Landsat8 images (30m/px) for Copiapo before (done) and after (ToDo) event
    • downloading Orbview 3 images (1m/px) for 6 Cities of Chile
    • installing new 2TB HDD disk to able to store and process the images
    • ToDo: still need to think about how to make the available as downloads or to just view/explore them
  • receiving, processing and adding data from CONASET:
    • highway accidents (carreteras) 2010-2012 Gran Santiago
    • road accidents 2009-2013 Gran Santiago
  • training to Helen: How to geo-code data with Nominatim (1d)
  • downloading and exploring geodata for "Nueva Alameda" project. However, most of the information comes in an unknown (falsly declared) cartographic coordinate system, so it can not be combined with other geo-data.
  • other (installing Win VMs for PhD student for processing, reviewing for journals CaGIS + TGIS, cocultancy to Buzz App project on how to update/edit OpenStreetMap data)

May 2015

  • Stefan:
    • processing and upload of high resolution aerial images (16cm/px) for Santiago 2007 and 2012 from SECTRA
    • replacing the static observatory webpage by a dynamic webpage based on the social network Elgg.org;
      • installing Elgg blog module: so we can write news
    • revising backup scripts (w.r.t image data backup and Elgg database backup)
    • meetings and 1/2 day GIS training for new workgroup "Mapeo Ciudades Norte" (Catalina Cortese y Sebastian Munoz ,from Fernando Perez),
    • Minvu "Observatorio de Barrios Sustentable";
      • creating a wiki page containing listing of indicators, barrios piloto and barrios modelo
      • meetings on data sources for indicators:
        1. Environmental Indicators: Athena C., Alejandra Vega, Francisco de la Barrera,
        2. Health Indicators: Alejandra Vega
    • updating Nominatim database for geo-coding (address => x,y)
    • research support for Juan Carlos Munoz: estimating ratio of street surface area to municipal area for Santiago, Sao Paulo, Concepecion, Temuco, Valdivia, Gran Coquimbo, Copiapo (all somewhere in-between 13% to 20%)
    • SWOT analysis of observatory
    • revisions to a IJGI paper (I am invited co-author)
  • Helen:
    • adding new users (list from Concepcion Conference)
    • together with Athena: evaluation of urban indicator session, Concepcion Conference => list of 79 basic indicators
    • compiling a list of data sources for the 79 basic indicators (ongoing)
    • uploading data:
      1. Concepcion (4): area metropolitano, indicadores barrios, areas verdes, ciclovias
      2. Valdivia (3): barrios, servicios de salud, areas verdes
      3. Temuco (1): servicios de salud
      4. Chile (2): equipamientos/servicios, manzanas censales 2002

=> now we have a total of 70 vector layers

June 2015

  • Stefan:
    • improving script for geo-coding traffic accident database and updating street database => cases with full directions (case 2) and crossings (case 3) can be geo-coded, success rate is about 80% for Case 2, and 50% for case 3 for RM
    • updating "Observatorio de Barrios" wiki : data sources for variables (our part)
    • strategic meetings and documents:
      • comite academico: developer needs / SWOT analysis + PI interviews
      • mobility cluster: data needs analysis + prospective data harvesting tasks
      • MJ : indicator webpage design
      • David : data from Controlaria.cl
    • meetings with teams "Linea-Base" Hub Stgo + Hub Conce: on city data for Gran Copquimbo, Copiapo
    • urban street area estimation for JuanCa (4+1 days)
    • re-setup of OpenTripPlanner for Santiago
    • trying to extract Census 2012 database => after several atempts finally managed it on 3. July , but data needs further processing (spatialization)
    • start working on GIS class for Diplomado Cedeus (content outline + data available + case study)
    • uploading several datasets available via IDE Chile page (Min. Interior/Carabineros, Min. Medio Ambiente + Conaf, Min. Obras Publicas, Digital Elevation Models) => in total about 58 datasets were uploaded

July 2015

  • Stefan:
    • working on & presenting 2 modules for Diplomado CEDEUS:
      • day 1: An (interactive) introduction to GIS
      • day 2: Licenses for Data & Software, GIS Data, GIS Software, Participatory Planning Tools on the Internet
    • research support:
      • Luis Rizzi: introducing a student to geographic accident data and GIS tools
      • generating a list of data useful for the mobility cluster
    • data:
      • downloading data from rulamahue.cl and datos.gob.cl
      • uploading SRTM 250m resolution DEM for Chile and RM
    • support of Helen in preparation of an Observatory Newsletter (now part of "Informativo del Barrio"), e.g. objectives & download stats
    • updates to the Wiki page on "Observatorio de Barrios" (MINVU)
    • registering domain "DatosUrbanos.cl"
    • meeting with Daniela from IDE CIGIDEN and to check how couple both DataCenters
  • Helen:
    • preparation and presentation of first Observatory Introduction Workshop, held in Concepcion
    • data uploads: EOD Temuco and Valdivia, BioBio: aerodromos, atractivos tur√≠sticos, paso fronterizos, centrales hidroel√©ctricas
    • preparation and Design for Observatory Newsletter
    • wrote blog entry on geocoding addresses with Google
    • update and ordering of Wiki sections on Indicator Workgroup , including upload of documents
    • revision of Stefans GIS modules for Diplomado CEDEUS

=> we have now a total of 137 layers and 117 documents

August 2015

  • Stefan:
    • data:
      • geo-referencing and uploading accidents Chile/Stgo 2008-2010, including Kernel Density Analysis 2000-2010 (3 days)
      • helping Sectra staff member to upload dataset "Zonas EOD Stgo 2012"
      • research support: calculation of 2008, 2009, 2010 accidents at random selected intersections for class/labs of Luis Rizzi (2 days)
    • reporting: writing Observatory report and outlook for Sept. Fondap Revision document
    • training:
      • visiting and presentation of CEDEUS Observatory at Int. Cartographic Conference (http://www.ICC2015.org ICC 2015), 23-28 August, Rio de Janeiro
        presention: "The CEDEUS Data Centre: Using open source mapping and communication tools to support research on sustainable urban planning"
      • visiting: 18th ICA Workshop on Generalisation and Multiple Representation (web, 21. August), Rio de Janeiro
    • meetings:
      • Sectra, MTT: data on transport planning etc. (G. Arias)
      • DTPM, MTT: data on transport Santiago (S. Tamblay)
      • Pedro Lizana: BIP & Bus GPS data
    • research:
      • work on WalkYourPlace (WYP) accessibility evaluation tool
      • manuscript revisions "Planning with Citizens: Implementation of an e-Planning Platform and Analysis of Research Needs" for ISPRS Journal of GeoInformation (4 days)
      • revision of poster for IGU Moscow (lead author: Francisco de la Barrera)
  • Helen:
    • outreach:
      • new blog post "Mapas en vivo: el ejemplo de Waze app."
      • observatory news entry for "Informe de Barrio"
    • data:
      • geo-referencing/adjustments and uploading 3 datasets from "Proyecto Nueva Alameda"
      • uploading PRC Y PLADECO documents for: Talcahuano, Tomé, Lota, Concepción, Coronel, San Pedro de la Paz, Chiguayante, Hualpén, and Penco
    • work on documents for indicator working group

Septiembre 2015

  • Stefan
    • capacitacion:
    • research:
      • writing full paper for XVII Congreso Chileno de Ingeneria Transporte (Concepcion)
  • ToDo: register domain host for correct forward
  • ToDo: implement geocoding of case 4: Rol Ruta + km value
  • ToDo: fix OpenSuse132 VM to be able to control UPS
  • ToDo: process and add data
    • rumalahue.cl data
    • accident database 2011-2014
    • accidents geocoded 2000-2008
    • evasion data
    • census 2012 micro data
    • from datos.gob.cl (downloaded already)
      • education data
      • mean temperature data
      • mean precipitation data
      • ...
  • contact for data:
      • Sectra
      • DTPM -> write Ley de Transparencia Request
      • Carabineros
      • UOCT
      • Pablo Mandujano: Street Speeds

ToDo List

Items del Observatorio - orden no indica la prioridad:

  • fix problem with GeoNode VM: "postgresql-client-9.1 : Breaks: postgresql-9.1 " as I can't install other stuff anymore : https://www.google.com/search?channel=fs&q=postgresql-client-9.1+:+Breaks:+postgresql-9.1&ei=91ODVaOXDai1sQTpq5ywBQ
  • tune GeoServer (gets slow for Catastro Bosque Nativo dataset, plus large point datasets)
  • try to move GeoTIFFs (220GB) from GeoNode VM to CedeusDB
  • instalar Network Managment Card del UPS
  • comienza calcular indicadores basicos para los 6 ciudades de CEDEUS
  • instala y personaliza Elgg como "Dashboard" para los 6 ciudades de CEDEUS, monstrando indicadores, mapas y informaciones basico (como un "Development project" en PlanYourPlace.ca/elgg/)
  • mejorar miCiudad segun comentarios de Helen (diseno) + acceso anonimo + bulk upload + ...
  • evaluar CartoDB para crear mapas tematicas en linea
  • evaluar como guardar y visualizar datos frequencia alta temporal (multi-diemensional), como datos de sensores, ej. GPS de micros
  • instalar Elgg como red social para usar
    • por comunicacion (blog/noticias/etc.)
    • perfiles de investigadores
    • como repositorio de documentos
    => hacer la como pagina de inicio del observatorio.
    • conectar with own zotero/web-dav?
    => see http://chronicle.com/blogs/profhacker/make-your-own-zotero-webdav-server-and-access-your-zotero-attachments-anywhere/38526?sid=wc&utm_source=wc&utm_medium=en
  • instalar cliente para mandar info por email
  • syncronisacion de login de diferente plataformas (Ldap)
  • subir datos interesantes por todos
  • heramienta para la georeferenciacion de datos basados en direcciones
  • twitter data logger (accidentes, alerta metro, sismos)
  • meteorologic data logger


Ayuda al Proyectos - corto plazo:

  • mapa/perfile contamninacion de buses : Hector Jorquera + Felipe Delgado
  • georeferenciar base de datos de accidentes de carabineros