Saturday, 18 February 2017

What is BigData and Hadoop ?

Data is a set of words, patterns, numbers etc..... It is raw in nature. Information is extracted from data by following some standard procedure based on the business knowledge is about taking decisions based on the extracted information.
Companies like google, Facebook, twitter, linked in have started a new business model of acquiring customers by providing completely free service. But they have to pay charges for their hardware and pay salaries for their employees. This forces these companies to make money from sources like advertisement.
The problem of understanding and categorizing customers or audience will come into picture because of this.
Eg :- If a person likes 3000 times in a day on an average then total number of likes will be 1 million approximately per year. To analyse these many likes taking an average of 1mb of data per like we have to process so much data.
In computer we have CPU, RAM and HardDisk in regular computer we can extend RAM upto 64gb. So,to process 1tb of data we need machine with 1tb of RAM, but the motherboard should replaced with 1tb supported RAM.
To improve this vertically computer scientist came up with super computer likes mainframes. But there will be a limit on the hardware based on advanced electronics and also super computer are very expensive. Hence analyzing big data with traditional hardware is a problem.

Big data analogy :- The ballet of US president election has to be conducted. If a single person has taken up the task of counting all the ballet papers it will be time consuming and very tired some that is also a big data problem. To solve this problem google came up with idea of scaling horizantally. In the give example of presidental elections if a team of people divide ballet into equal parts and count them and came up with individual intermediate number then they can count the ballet number to get the result.
To solve the problem of big data google published two white papers out of which one describes GFS (google file system) and another GMR (google map reduce). In this solution data will be distributed across several machines and analyse individually and come up with intermediary solution. These results will later be crunched again to come up with final result. The implementation of this solution is known as Hadoop.

Hadoop :- Hadoop is the implementation of two white papers published by google and it is the solution of bigdata. GFS is implemented as hadoop distributed file system(HDFS). Where as google map reduce was implemented as MapReduce.
Cluster is as set of multiple nodes (computers, servers etc.....).

Virtual Machine :-  To share physical resources with out any conflict by multiple machines virtually virtual machine software will be helpful.
Eg :- VMware, oracle-virtual box.

Introduction to new delicious windows package manager(Repository) || Chocolatey (Like linux repository)

Most of the windows users don't know the internal installation of software installed in windows operating system. Many of the people are habituated by downloading and easily installing (.exe and .msi) software's files. But previously the only way to install software in by MSDOS commands because there is no user interface to click next..next.........next. 
The usage of commands is best practice in the world of computers because it teaches the internal part of installation and working of the operating system.
Still, now Linux operating system uses dedicated commands to install its packages. So, Linux mLinux best and robust operating system. As the increase of the user interface in Linux doesn't effect the usage of commands in Linux and Unix.
All the packages of Linux are stored in the repository. The repository is a database of packages which stores them and can access them by using commands.
Ex : Linux- yum repository for RedHat OS, an apt-get repository for Debian based Linux OS.
So, to maintain the same concep of Linux in windows a repository was introduced named chocolatey
which contains all the softwares related windows as packages. Now you can insall and software by using commands in windows command prompt.

Chocolatey is totally command line interface for windows which provides functionalities such as install, update and uninstall of addon and programs(softwares). Just one line command is enough for downloading and installing your software.

Process of installing Chocolatey in windows :-

  • Open the command prompt as Adminstrator privileges.
  • The the command prompt windows should be like C:\windows\system32.
  • Copy the below command and past it in your cmd.
  Command :- @powershell -NoProfile -ExecutionPolicy unrestricted -Command "iex ((new-object net.webclient).DownloadString('https://chocolatey.org/install.ps1'))" && SET    PATH=%PATH%;%ALLUSERSPROFILE%\chocolatey\bin
  • Then click enter in your keyboard. It will start installing chocolatey in yours windows OS.
Commands for installing packages by using chocolatey :-
  • choco install package-name (Command 1)
  • cinst package-name (Command 2)
Commands for installing multiple packages :- 
  • cinst package-name, package-name, package-name..........(Command 3)
You can also create Xml file with extension .config and can run it.
Ex :- 
<?xml version="1.0" encoding="utf-8"?>
           <packages>
                <package id="UTorrent" />
                <package id="notepadplusplus" />
                <package id="IrfanView" />
          </packages>
To update a package :-
  • choco update package-name(Command 4)
To uninstall a package :-
  • choco uninstall package-name.
Thats ALL!!!



Friday, 17 February 2017

How to link Web Email Address to Gmail Account

Many of the people are having their own websites for managing their content and for other purpose. All of them who are maintaining websites will use email services provided by the hosting services.

The main purpose of this web email to identify their organisation or brand by website name. The web email contains website name with domain at last of web email account.
Ex :- saiakhil46@technonuggets.tk 

The mentioned email is web email that contains the email id and website name such as @technonuggets.tk. 

To manage this web email account we have to go to  cpannel provided by hosting. So,to avoid the inconvenient   we can link that web email to our normal gmail accounts. By linking both webemail and normal gmail we can manage both accounts at one place.

The process of linking web email and normal gmail is given below :-
  1. Log in to your gmail account.
  2. Goto settings which is located at right hand side of the gmail page contains gear symbol.
  3. After that goto Accounts and Import tab.
  4. In that tab you will find Check mail from other accounts: option.
  5. Click on Add mail account and enter your web email address.
  6. Select radio button on Import emails from my other account (POP3) and click next.
  7. In the username field, fill yours entire web email.
  8. In the password field, fill yours password.
  9. Select Port 110 for a POP3 connection. For a secure email connection, use Port 995.
  10. Select the checkboxes according to yout requirements.
            Leave a copy of retrieved messages on the server.
            Always use a secured connection SSL when retrieving emails (Do not check this box).
            Label incoming messages.
            Archive incoming messages.
   11.  Click Add account.


After adding yours account, you need to have the option of making add account a custom from address. This will allow you to compose messages in gmail but appear to sent from your other email account.

In the next follow these steps :-
  1. Change the SMTP Server address to your webmail SMPT server provided in info session of webmail.
  2. Change the port to 25.
  3. Click on Add account.
The last thing you have to do is confirm by checking your email.

In  order to get the emails, you have to goto webmail.yourwebsite.com and do following steps :-
  1. Login with your new email and password you created.
  2. Check the email from gmail team and either click the confirmation link provided inyour email account.
THATS ALL !!!

Saturday, 14 January 2017

Risk Control Strategies

Risk control strategies are control measures which are used to control risk factors in
IT ans information security sectors. There are many types of control strategies.

  • Selection of control strategies depends on risk or threat obtained in IT sectors.
  • The main tool in this process is risk assessments because it plays and important role in selection of strategies.
  • The total process consists analyzing the obtained risk and determining vulnerability selection by choosing risk control strategy.
  • Risk management is also a part  of the process because calculating the amount of risk is important.
  • There are many types of threads such as software errors, hardware errors, human errors, social engineering and soon.
  • Hardware errors is basically due to commodity hardware in case of hadoop distributed file system and MapReduce.
Some of the mistakes in security are:-

  1. Not watching for dangers with in your own organisation 
  2. Plug and play which installs and configure hardware without security.
  3. Virus through emails.
  4. Human risks such as reveling passwords to others.
  5. Software which are having loopholes which is available to script kiddies.
Types of Risk control strategies:-

  • Risk Avoidance
  • Risk Transformation
  • Risk Migration
  • Risk Acceptance
1) Risk Avoidance :- The strategies which is used to prevent attacks to organisation assets through vulnerabilities. It is most acceptable because it was avoiding the entire risk. It includes adding protective safeguards, limited access to resources, removing vulnerability in assets.

2) Risk Transformation :-  It helps in protecting the assets from other effected assets. It prevents transfer of risk from one assets to other. It is the choise for large organisation with large amount assets. It includes re-engineering services , revising development models, out sourcing to other organisation.

3) Risk Migration :- It is the process of reducing impact of threads to the assets with specified and defined measures. All migration strategies starts in early stages.

4) Risk Acceptance :- It is the process of doing nothing to protected vulnerabilities and accepts the outcome of its exploitation.

Each of these strategies depends on the ability to detect and respond to an attack as quick as possible.