./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-1.pdf

  • My summarization.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-2.png

  • This research creates whole new area for consumers and industries.
  • A search engine that archives your life but there are problems.
    • Data security with always a possibility to be breached.
    • Privacy of the lifelogger and their surroundings.
    • Where to store the big data.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-3.png

  • Ideally we need a set of sensor that can record anything.
  • Human experience is very complicated.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-4.png

  • Example of visual lifelogging with video sensor.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-5.png

  • Easy to do audio logging.
  • Easy to do video logging.
  • However there are some dimensions those are not easily measurable.
    • Feeling.
    • Taste.
    • Touch.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-6.png

  • There are some "badges" those can be (primarily) used to lifelogging.
    • Google Glass (experiment from Google, I think this is never get into consumer hand).
    • Narrative Clip (is a casual Go Pro camera, this is the only solution to buy at this moment).
    • OMG Autographer (the company closed).
    • Vicon Revue (Microsoft SenseCam, however, this is not on sale).

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-7.png

  • Data storage is important.
    • HD video takes so many spaces.
    • Accelerometers and location beacons take less data but also less information.
  • There is this book titled "Lifelogging Personal Big Data".
  • This book is basically a very big research paper about lifelogging.
  • It is worth the read to help me for this project.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-8.png

  • Example data from logging.
  • For example.
    • Media lifelogging.
      • Instagram.
      • YouTube.
      • ....
    • Activity.
      • FitBit.
      • Nike Run.
      • ....
    • Information access.
      • LoggerMan.
      • Rescue Time.
    • Location.
      • Google Maps.
      • GPS.
      • Swarm.
    • Others.
      • Diet.
      • EEG (brainwaves).
      • Gene (23&Me).
      • Health.
  • The platform made for this project is called "EyeWare".

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-9.png

  • For software, ideally there would be an integrated platform for all values.
  • However, there is none just yet.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-10.png

  • Example implementation of application that aggregated all sensors values.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-11.png

  • There is Teemu Arina.
  • A Google Calendar plug - in for tracking.
  • Nevermind, Teemu Arina is a actually a person.
  • His is her Twitter, https://twitter.com/tar1na.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-12.png

  • Conventional QS style lifelog.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-13.png

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-14.png

  • OMG Autographer has its own application to manage videos.
  • However, now the company behind OMG Autographer is closed.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-15.png

  • Mobile application from the Narrative Clip.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-16.png

  • The EyeWare platform.
  • Looking through Google, there is no information on this EyeWare platform.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-17.png

  • The use machine learning and AI as a context agent.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-18.png

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-19.png

  • Another screenshot of EyeWare platform.
  • The later part is about EyeWare visualization.
    • I think the bigger image indicates stronger events?

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-20.png

  • The automatic visual diaries.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-21.png

  • Lifelogging as population studies.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-22.png

  • The problem is now on who you would trust your data?
  • Will personal server be a thing in the upcoming future?

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-23.png

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-24.png

  • There is Loggerman.
  • Loggerman is a personal keylogger.
  • It tracks its user and giver a report and screenshot, on, for example which application that the user mostly used, time, habit, ....
  • This is lifelogging for your computer activities.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-25.png

  • Samples of privacy awareness.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-26.png

  • The focus of this project is to make a personal search engine.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-27.png

  • The current problems for this project.
    • Few devices to test.
    • Limited software.
    • Privacy.
    • Trust on sharing storage.

./20170404-0144-cet-state-of-the-art-25-lifelogging-presentation-a-15-millions-image-lifelog-28.png

  • Experiences (I am not sure on what is this slide want to tell about).
    • Get data now. This means realtime data transfer and processing as fast as possible I think.
    • Who will the user trust for personal data?
    • Few real - world problems. I think that there is no apparent need for a personal search engine just yet.
    • New tools to extract value.
    • Introduce people into insight of themselves.
    • Storage problem. This project is about personal big data.
  • Increasing social interactions.