1.1 Problem Summary
In order to stay competitive in your respective industry or market, you must be able to evaluate how branches, products, services or your company is functioning. Identifying trends in your data will ensure that you can take immediate corrective action to ensure that production, delivery or service never falls. This will elevate your company's performance - and that should be enough reason to user your data to drive business decisions.
Business Intelligence is using various set of methods and tools for making decisions by business organizations to achieve a maximum benefit and making predictions based on historical data of organization.
Business intelligence (BI) has become an expected business competency for improving decision-making effectiveness. Leading enterprises are establishing competency in aspects of BI such as decision modelling and support so that all workers, managers and executives can take the most effective action in a given business situation.
As the industry grows very rapidly, historic data, transactional data, other business related data amount is also growing exponentially. The data in raw excel sheets becomes cumbersome to handle. Transformation of large amount data to authenticated users only in secure manner is very crucial task and which is hard to handle.
Business related Analysis or mining of useful information becomes very hard in decentralized excel sheets.
Some business organizations uses excel as their BI tool. Excel is very flexible and is almost limitless in its value to users. However, we can't use Excel as a primary BI tool, and by doing so, the entire organization can be get in trouble.
Currently excel provides visualization but we can't have drill down map facility in excel. Integration of data from different sheet becomes difficult to handle when data size becomes larger. Along with that prediction is also not possible with excel.
In excel, we can't have schedule based automatic report generation facility. Also we can't send these reports to sub level person automatic.
Hence, we are motivated to develop Telecom Zonal Analysis Business Intelligence Toolkit -TelZABIT.
TelZABIT tries to ensure that the quality of analysis process in any business organization is improved through the integration of data from different sources and storing it in database in common format. This project provides analysis system where admin will load up-to-date data through GUI interface and other business managers will be able to analyse those updated data and can do reporting, prediction according to their access level.
This project is being generated by the sole objective of assisting and helping business analyst in giving the best, early as well as comparative, predictive analysis of various KPIs (key performance indicator) in visual representation.
The project aims at uniting the various sections of the organization to make it work like a system as a whole in order to make use of the system more efficiently.
The main objective of this project is to ensure more reliable and fast data visualization which minimizes the time expenses and improves the quality of results.
This project tries to ensure that the quality of analysis process in business organizations is improved through the integration of data from various sources and storing it into database in common format. This project provides analysis system where admin will load up-to-date data through GUI interface and other business managers will be able to analyse those updated data and can do reporting, prediction according to their access level.
Chapter 2 : Literature Review
EXCEL is often used for data reporting and analysis in businesses organizations but it has limited capabilities to visualize data, publish it to the Web, share it amongst users and generate reports according to access level of user.
EXCEL allows other producers to customize and extend its capabilities through the use of plug-in modules. Data entered through the EXCEL front-end interface can then be processed in the background by web servers on the Internet without the user having to learn to use a new business system.
SAP, Business Objects, Oracle Systems, IBM ESS Space, and other sophisticated business analysis and reporting systems are suitable for large enterprises. These type systems are expensive, and are intended to be utilized by highly skilled specialists and top-level persons.
TelZABIT allows to analysis whole data of company in graphical include including many views(drilldown, bar, building, pie) as it encrypt the whole data so provide sufficient level of security, tool use AES-128 bit encryption and decryption as well tool is basically SAAS so for more authentication we have used LDAP (Lightweight directory access protocol) so this will add more security to tool this tool not only provide BI it also provides custom-base reporting for whole level users and reporting can be in different formats.
Chapter 3 : Requirement Analysis and Design
3.1 System Architecture
Fig 3.1 Flow Diagram of System
For Views: user will login on TelZABIT and credentials will be matched with LDAP server. On success, spring will get data from mongoDB according to user's access level and views will be generated.
For Reporting: user will login on TelZABIT and credentials will be matched with LDAP server. On success, spring will get data from mongoDB according to user's access level and data will be passed to node.js server to export images. Python server will use exported images and generate PDF.
3.2 Class Diagram
Fig 3.2 Class Diagram for System
3.3 Use case diagram
Fig 3.3 Use-Case Diagram for system
Fig 3.4 Use-Case Diagram for Report Module
Fig 3.5 Use-Case Diagram for Views Module
3.4 Sequence diagram
Fig 3.6 Sequence Diagram for Login Module
Fig 3.7 Sequence Diagram for Report Module
Fig 3.8 Sequence Diagram for View Module
3.5 Activity diagram
Fig 3.9 Activity Diagram for Login Module
Fig 3.10 Activity Diagram for Report Module
Fig 3.11 Activity Diagram for Views Module
Fig 3.12 Activity Diagram for Security Module
Chapter 4 : Technologies Used
4.1 Software requirement
Framework Spring MVC 4.0
Code Behind (Business logic) Java
Database Server mongoDB 3.2.8
Web server Pivotal tc server 3.1.5
Authentication server Apache DS 2.0.0
Image exporting Node.js server
PDF generation Python server
4.1.1 Spring MVC Framework
Spring framework is an open source Java platform that provides comprehensive infrastructure support for developing robust Java applications very facilely and very rapidly. The Spring framework comprises several modules such as IOC, AOP, DAO, Context, ORM, WEB MVC etc.
Spring enables you to build applications from "plain old Java objects" (POJOs) and to apply enterprise accommodations to POJOs. This capability applies to the Java SE programming model and to full and partial Java EE.
Java is a high-level programming language originally invented by Sun Microsystems and released in 1995. As per Java language's white paper by Sun Microsystems: "Java is very simple, object-oriented, distributed, interpreted, robust, secure, architecture neutral, portable, multithreaded, and dynamic."
JSP : Java Server Pages (JSP) is a technology that helps software developers to develop dynamically generated web pages with use of HTML, XML, or other document types. Released in 1999 by Sun Microsystems, JSP is similar to PHP and ASP, but it utilizes the Java programming language.
MongoDB is an open source database that utilizes a document-oriented data model. MongoDB is one of the database types which is arise in the mid of 2000s under the NoSQL scheme. Instead of using tables and rows as in RDBMS, mongoDB architecture creates collections and documents.
4.1.5 Pivotal tc Server
Pivotal tc Server provides secure, supported, and integrated Java web application server, which is based on Apache Tomcat Server. It additionally provides real time insight into the performance and behaviour of Spring applications.
4.1.6 Apache DS
ApacheDS 2.0 is an embeddable, extendable, standards compliant, modern LDAP server. LDAP server is fully written in Java, and it is free to use under the Apache Software License system. Other network protocols like Kerberos and NTP are supported as well, but basically ApacheDS is an LDAP server.
4.1.7 Node JS Server
4.1.8 Python Server
Python is an open source and dynamically interpreted language. There are no type declarations for variables, arguments or function's return type in source code. We have used python for creating pdf from images which was given by node.js server. The Python have large standard libraries base which are freely available for all major platforms.
4.2 Hardware requirement
Processor Intel core i3 or higher
Random Access Memory 2 GB
Free space available 10 GB
Internet connection 1 Mbps
Chapter 5 : Design
When defining the project scope, our team explored the immediate project activities, objectives and end results. All of them are placed either inside or outside of the project scope. All of these activities and objectives are jotted down on the canvases.
5.1 AEIOU Summary
The below diagram depicts the Activities, Users, Interactions, Objects and Environment of the location we visited to get the idea of our system. It shows the observation and special elements of all the above modules.
Fig 5.1 AEIOU Summary
ACTIVITIES includes View-Generation, Analysis, Searching, Decision Making, Problem Resolving, Calling, Data Processing, Computer, Laptops, Browsers, Notice Board, Smart Phones, Projectors.
ENVIRONMENT includes Systematic Work, Discipline, Group Activities, Meetings, Good Ambiance, Uniform, Smart Phones, Laptops, Servers.
INTERACTIONS includes Human-Resource Manager with Employees, Human-Resource Manager with CEO, COO, Employees with Media, Zonal Heads with Lower Level Heads, Callie with Employees, Computer Labs, Meeting Rooms, Offices.
OBJECTS includes Scanning, Typing, Planning, Smart phones, Computers, Fax, Land Lines, WI-FIs.
USERS includes Engineers, Business Experts, Technical Team, Department Heads, Callie, Employees, Human-Resource Manager, CEO, COOs.
5.2 Empathy Mapping
An empathy mapping canvas is a collaborative tool. Using which teams can gain a deeper insight into their customers. Much like a user's personal, an empathy mapping canvas can represent a group of users, such as a customer segment. The components of empathy mapping are users, stakeholders, activities, story boarding (two happy and two sad stories).
Fig 5.2 Empathy Mapping
USERS includes Business Experts, All Level Heads, Managers, Employees.
STAKEHOLDERS includes System Architect, DBAs, Internet Providers, Software Engineers.
ACTIVITIES includes Data Visualization, Data Loading, Decision Making, Report Generation, Data Analyze, Reporting, Prediction.
5.3 Ideation Canvas
An ideation canvas is a rough whiteboard on which we can stretch our ideas into any limits or dimensions. Ideation canvas is not aimed at finding solutions to the defined problem but to define the best possible problem and find out its possible scope.
The ideation canvas includes people, activities, situation/context/location, props used in the project.
Fig 5.3 Ideation Canvas
PEOPLE includes Business Experts, Team Heads, Managers, Callie, Technical Team, Networking Team, Technical Staff, System Admin.
ACTIVITIES includes Analysis, Planning, Surfing, Searching, Negotiation, Visualization, Reporting, Monitoring, Data Processing, Predictions.
SITUATION/CONTEXT/LOCATION includes Cabins, Offices, Homes, Meeting Rooms, Data Analysing, Report Generation, Data Visualizations.
PROPS includes Excels, Reports, Work Experiences, IOS Apps, Android Apps, Servers, Prediction Tools, SAAS, Business Tools, Browsers.
5.4 Product Development Canvas
Product development canvas involves the purpose of the project, people involved, experience, function and features of the project, components involved customer revalidation and reject, redesign and retain plan adapted after the customer revalidation.
Fig 5.4 Product Development Canvas
PURPOSE includes Decision Making, Data Visualizations, Reporting, Predictions.
PEOPLE includes All Level Heads, Business Experts, Employees, All Managers.
PRODUCT EXPERIENCE includes Robust, Secure, Highly Reliable, Fast.
PRODUCT FUNCTIONS includes Data pre-processing, Data Visualization, Comparison, Reporting, Prediction.
PRODUCT FEATURES includes SAAS, Data Comparisons Using Different Charts, Machine Independent, Secure Data Transmissions, Drill Down Facility.
COMPONENTS includes ReactJS, Mobile, SAAS, Application, Robomongo, Eclipse ADT/Android Studio, Spring Tool Suits, Database Server.
CUSTOMER REVALIDATION includes Offline Tool Should Be Available, Synchronization.
REJECT, REDESIGN AND RETAIN includes Retain.
5.5 Business Model Canvas
The figure below projects the Business Model Canvas. The Business Model Canvas is a strategic management and lean start up template for developing new or documenting existing business models. It is visual chart with elements describing a firm or product's value proposition, infrastructure, customers, and finances. It assists firms in aligning their activities by illustrating potential trade-offs.
Fig 5.5 Business Model Canvas
KEY PARTNERS includes Amazon web services, mLab.
KEY ACTIVITIES includes Platform development, Selling.
KEY RESOURCES includes TelZABIT Platform, Marketing and Sales.
VALUE PROPOSITIONS includes Free Basic Business Intelligence, Premium BI, Reporting.
CUSTOMER RELATIONSHIPS includes Product Documentation, Business Assistance, Automated reporting services.
CUSTOMER SEGMENTS includes Niche market, Business persons.
CHANNELS includes Business assistance, Corporate Networks.
COST STRUCTURE includes Web hosting, Product development.
REVENUE STREAMS includes Subscription fees, Product feature development.
Chapter 6 : Implementation of the System
6.1 TelZABIT Modules
Module 1: ETL
ETL stands for Extract Transform Load. In the first part, data will be extracting from different data sources. Sources can be homogeneous and heterogeneous. In second part Data should be database structure will be decided from given data sheets. In the last part, data will be loaded in target database according to above defined database structure.
Module 2 : Authentication
Authentication is the process of determining whether someone or something is who or what it is declared to be. To access most technology services of Indiana University, you must provide such proof of identity.
Module 3 : Security
Security is very crucial aspect. At the server side first data will be fetched, then it will be encrypted using the logged user's User key and then it will be sent through secure channel. At client side that data will be decrypted by key and that key will be asked from User. If key will be matched then only View will be rendered With Actual data.
Module 4 : Views
Data for the KPIs selected by user will be fetched according to that user's access level from database and views will be generated using those data at client side. Views contain comparative graphs, charts, maps with drill down facility.
Module 5 : Reporting
In reporting module, last month's report would be generated according to user's access level. In reporting module, option is given for KPIs selection for report generation. Report contains graphs and analytics compare to previous month for selected KPIs.
6.2 TelZABIT Implementation Screen shots
Fig 6.1 Screenshot of ApacheDS configuration
Fig 6.2 Screenshot of LDAP User creation
Fig 6.3 Screenshot of TelZABIT Login
Fig 6.4 Screenshot of Minutes usage chart
Fig 6.5 Screenshot of Minutes usage bar chart of selected date
Fig 6.6 Screenshot of Access hierarchy according to login data
Fig 6.7 Screenshot of analytics
Fig 6.8 Screenshot of reporting module
Fig 6.9 Screenshot of Generated report
Chapter 7 : Conclusion and future work
We have successfully implemented authentication using LDAP and apache directory server. This server provides the data access as per the role of user in hierarchy of position and login data.
Furthermore, this project is used as SAAS (Software as services). Hence, we have added security module to this tool using AES-128 bits that makes it more secure and less vulnerable.
For Views, we have used highchart JS and generated many views for client data for the users to analyse the whole data of organization as per their need, and we have also provided the core analysis for many of KPIs (Key Performance Indicator) like total churn, port-in, port-out, 2G, 3G, gross adds, net adds, total time usage etc.
As seen, TelZABIT is used as SAAS and hence, it should have fast data processing capability and also have strong resistance ability against heavy traffic of data. As a result, we have used mongoDB as database. It have properties like sharding and replication which makes mongoDB best suitable for TelZABIT.
This tool also provides reporting feature that, produce the report contains all KPIs monthly analytics in terms of graphs.
Hence, we can conclude that above mentioned all modules implementation will make TelZABIT more faster, robust, secure.
7.2 Future Work
Future work may involve the enhancement on more view of data-representations, and also provision of many other predictions to existing tool to benefit the analyst with more views. this tool will also suggest some conclusions to users so the users can make better decisions for future moves of organizations.
Chapter 8 : Bibliography
1. For Spring MVC and Java
2. For MongoDB
3. For Python
4. For Node.js
5. For react.js
6. For LDAP and apache directory studio
...(download the rest of the essay above)