Big Data, Social, wearable and publically available data.
$250-750 USD
Closed
Posted over 9 years ago
$250-750 USD
Paid on delivery
Requirements:
Whole architecture presented should take into account that the process end-to-end needs to be fully automated.
The best technical proposal in the shortest time won the project.
Objective: Create dashboards versus panels with a unique 360 degree vision of customers. This information must always be updated in real time to determine if valuable customer insight can be obtained from the ocean of data from social media and wearable devices.
High Level Steps
-----------------------
0) Present a reference architecture that solves an Automated process for Big Data, Social, wearable and publically available data, following requisites:
inputs
------
1) Collect information from clients through an API. The return comes in JSON format. After calling the API and needed to download a [login to view URL] which after
extraction will have a folder structure for clients ie if 1000 were extracted customers we have 1000 folders each of which will have only one JSON. the Folder name and numeric ID of the client.
2) Create a Web page that knife User Authentication Jawbone order to collect information from devices of Health,
if the first device will be the Jawbone. Will be necessary to consume all of their respective endpoints via API -> Broker -> Hadoop.
Management
----------
3) Information above should be managed in Hadoop and its respective ecosystem. Cloudera distribuition should be installed on a cluster.
Pentaho PDI would be a more agile option and a PLUS.
Necessary information from the client and health (Jawbone) as well as others that may arise must be stored in NoSQL database so that they can run ETLs for viewing data *.
outputs
--------
4) Create a panel that shows customer data always updated.
5) create a panel that shows the health data collected by Jawbone. Interesting metrics that show the lifestyle and behavior of the person.
6) Create a panel that shows Customer life events based on their social networks in which it is involved. These data cames also in social networking API (JSON) client.
*Display will be able to be used: Jasper, D3.JS or Tableau.