This Data Awareness Programme conducted in Kadaladi Government School in Ramanathapuram, which is based in Southern India on 15/04/2014. This programme was uniquely designed to deliver the importance of day to day data, that can help school students to better understand, analyse and help his/her school & personal activities on a day to day basis. This program was mainly targeted towards school students (standard 9, 10, 11, 12), teachers & parents no matter whatever their industries were.
This awareness programme, includes any data related to personal, individual, education & social by Your SQL Man UK Ltd and was successfully delivered, by its CEO, Dr. Subramani Paramasivam and his team members. This awareness programme was first of its kind and helped school students, teachers in this very remote village Kadaladi.
The audience were unbelievably surprised with the level of information provided about data and how to learn more about data and analyse and help themselves and their surroundings including friends, family, relations, and local people in and around. The attendees were amazed with the level of information that was provided for about 8 hours with easy to understand slides & related videos. Dr. Subramani Paramasivam who is also a Principal Consultant and Trainer, travels around the world to deliver, high quality training and consultancy to corporate clients and participates in worldwide technical events and decided to deliver the same International Standard for this Awareness Programme.
This awareness also included the introduction of Microsoft products, that will better help their day to day life and enlightened the opportunities provided by Microsoft for students. Unbelievably the school students were not aware of Microsoft and this became a good opportunity for Your SQL Man UK Ltd to better explain about the Microsoft products, certifications and awards at student level like MTA (Microsoft Technology Associate) & MSP (Microsoft Student Partner).
Fun & Gifts
This program was delivered with fun and been given gifts to encourage the students to answer the Microsoft & Data related questions. Students & teachers bagged many gift items by answering the questions and left with hand full of gift items. The college principal and the school Head Master thanked for the enlightenment that was brought into the students life which was the first kind of a program they attended.
Some of the areas within this programme were delivered with fun to ensure the attendees have better understanding of data. So used some of the movie entertainment video clips which speaks about realistic data, facts and gave enough props and examples to feed their mind with better understanding.
Speaking to the CEO of the company, Dr.Subramani Paramasivam mentioned that this was his dream to get the awareness of education, social through data and been working on it for a while and brought this Data Revolution a successful one. He also added that, many rural areas in and around the world are still not aware of the effectiveness of IT in particular Microsoft student partnership & certifications programme and using this awareness programme opportunity to enlighten them.
This is definitely a data revolution which can make every person even in rural areas to get educated and help others.
A BIG THANK YOU FOR SCROLLING DOWN ALL THE WAY DOWN TO SEE THE SUCCESS OF DATA AWARENESS PROGRAMME AT KADALADI SCHOOL IN SOUTHERN INDIA.
The following table presents an overview of the components of a business intelligence system, and the corresponding Microsoft SQL Server 2000 and SQL Server 2005 components.
|Component||SQL Server 2000||SQL Server 2005|
|Extract, transformation, and load||Data Transformation Services (DTS)||SQL Server 2005 Integration Services|
|Relational data warehouse||SQL Server 2000 relational database||SQL Server 2005 relational database|
|Multidimensional database||SQL Server 2000 Analysis Services||SQL Server 2005 Analysis Services|
|Data mining||SQL Server 2000 Analysis Services||SQL Server 2005 Analysis Services|
|Managed reporting||SQL Server 2000 Reporting Services||SQL Server 2005 Reporting Services|
|Ad hoc reporting||SQL Server 2005 Reporting Services|
|Ad hoc query and analysis||Microsoft Office products (Excel, Office Web Components, Data Analyzer, SharePoint Portal)||Microsoft Office products (Excel, Office Web Components, Data Analyzer, SharePoint Portal)|
|Database development tools||SQL Server 2000 Enterprise Manager, Analysis Manager, Query Analyzer, various other||SQL Server 2005 Business Intelligence Development Studio (New!)|
|Database management tools||Enterprise Manager, Analysis Manager||SQL Server 2005 SQL Server Management Studio (New!)|
I will get back to you in my next post. All the best for your definition PLUS hunt.
It was a hard part initially to make use of balancing the resources for all users with different groups. We can make use of IS_MEMBER() function, but the Function Classifier need to be derived accordingly. Also this is not an 100% workout to get the ideal result. I have recently come out with good work around to sort out this issue.
To give a scenario, I have 3 sets of SQL users. Moreover I also have replication stuff going on.
1. Business Team with developers knowledge
2. Business team with basic knowledge + pivot table manipulators in excel
3. IT team
I need to balance the users login on one side & the replication on the other.
I have used 3 Workload groups & Resouce pools on top of the server’s default & internal pools.
–**CREATE RESOURCE POOL **–
CREATE RESOURCE POOL SSUsers
WITH (MAX_CPU_PERCENT = 2, MAX_MEMORY_PERCENT = 2);
CREATE RESOURCE POOL DevUsers
WITH (MAX_CPU_PERCENT = 4, MAX_MEMORY_PERCENT = 4);
CREATE RESOURCE POOL Distribution
WITH (MIN_CPU_PERCENT = 15, MAX_CPU_PERCENT = 40, MIN_MEMORY_PERCENT = 40, MAX_MEMORY_PERCENT = 60);
–to reconfigure the created resource pools, i used the following
ALTER RESOURCE GOVERNOR RECONFIGURE;
–the below query displays the newly created resource pools with its ID.
SELECT * FROM sys.dm_resource_governor_resource_pools;
–**CREATE WORKLOAD GROUP **–
–create workload group to assign to the resource pools
CREATE WORKLOAD GROUP WG_SSUsers
CREATE WORKLOAD GROUP WG_DevUsers
CREATE WORKLOAD GROUP WG_Distribution
–to reconfigure the created resource pools, i used the following
ALTER RESOURCE GOVERNOR RECONFIGURE;
–the below query displays the newly created workload groups with its ID.
SELECT * FROM sys.dm_resource_governor_workload_groups
I am going to write a classifier function that will distinguish the users and the replication database and allocated the workload groups accordingly.
Before creating the classifier function I need to have all the list of users underneath their group level. In our case, I had issue in using IS_MEMBER() function where it was able to allocate resource for the first set of rules defined in the classifier function. Then I came out with adding the list of user to a physical table with their permissions level in the master database. You can execute the following against your master database.
CREATE TABLE RG_Users_Group
RG_Name NVARCHAR(15) NULL,
Username NVARCHAR(25) NULL
INSERT INTO rg_users_group VALUES (‘SS_Users’, ‘AB01\user1′)
INSERT INTO rg_users_group VALUES (‘SS_Users’, ‘AB01\user2′)
INSERT INTO rg_users_group VALUES (‘SS_Users’, ‘AB01\user3′)
INSERT INTO rg_users_group VALUES (‘SS_Users’, ‘AB01\user4′)
INSERT INTO rg_users_group VALUES (‘Dev_Users’, ‘AB01\user5′)
INSERT INTO rg_users_group VALUES (‘Dev_Users’, ‘AB01\user6′)
This creates a list of all users with proper Resource Group name. The output of the table looks like this.
Once the table is created then I write my classifier function here.
–create the classifier function to assign the workload groups
IF OBJECT_ID ( ‘dbo.RGov_Classifier’) IS NOT NULL
DROP FUNCTION dbo.RGov_Classifier;
CREATE FUNCTION dbo.RGov_Classifier ()
RETURNS sysname WITH SCHEMABINDING
SELECT CASE WHEN SUSER_NAME() IN (SELECT username FROM dbo.rg_users_group WHERE RG_name = ‘SS_Users’)
WHEN SUSER_NAME() IN (SELECT username FROM dbo.rg_users_group WHERE RG_name = ‘Dev_Users’)
WHEN ORIGINAL_DB_NAME () = ‘distribution’
–register the classifier function to the RG.
ALTER RESOURCE GOVERNOR
WITH (CLASSIFIER_FUNCTION = dbo.RGov_Classifier);
ALTER RESOURCE GOVERNOR RECONFIGURE;
Now the creation of all resource pools, workload groups, table & classifier function is done. It is time to check how the resource group works. So I have the following query to check each resource pools & their average response in milliseconds.
RP.name as PoolName,
COALESCE(SUM(RG.total_request_count), 0)as Total_Request,
COALESCE(SUM(RG.total_cpu_usage_ms), 0)as Total_CPU_in_MS,
WHEN SUM(RG.total_request_count) > 0 THEN
END as Avg_CPU_in_MS
sys.dm_resource_governor_resource_pools AS RP
LEFT OUTER JOIN
sys.dm_resource_governor_workload_groups AS RG
RP.pool_id = RG.pool_id
In the above query, I have used the DMV (Dynamic Management Views) to help in identifying the resources used for each pool.
PoolName Total_Request Total_CPU_in_MS Avg_CPU_in_MS
DevUsers 3644 13412519 3680
SSUsers 50 243846 4876
distribution 1340523 16428325 12
default 621057 822676774 1324
internal 0 3182271 0
In the above scenario, I made sure all the resource pool now works fine.
This is not an 100% solution, and still have some work around to better up the results. But still a good work around compared to the other scenario.
Let me know if you need any clarifications on this.
Business intelligence (BI) is a broad category of application programs and technologies for gathering, storing, analyzing, and providing access to data to help enterprise users make better business decisions. BI applications include the activities of decision support, query and reporting, online analytical processing (OLAP), statistical analysis, forecasting, and data mining. In particular to Microsoft, it supports 3 types of OLAP technology, they are
1. MOLAP: Multidimensional OLAP
2. ROLAP : Relational OLAP
3. HOLAP: Hybrid OLAP
I shall post these definitions in my further posts.
As promised in my previous post please find the definitions, PLUS some more information on the characteristic nature of the post title.
This is the traditional mode in OLAP analysis. In MOLAP data is stored in form of multidimensional cubes and not in relational databases. The advantages of this mode is that it provides excellent query performance and the cubes are built for fast data retrieval. All calculations are pre-generated when the cube is created and can be easily applied while querying data. The disadvantages of this model are that it can handle only a limited amount of data. Since all calculations have been pre-built when the cube was created, the cube cannot be derived from a large volume of data. This deficiency can be bypassed by including only summary level calculations while constructing the cube. This model also requires huge additional investment as cube technology is proprietary and the knowledge base may not exist in the organization.
The underlying data in this model is stored in relational databases. Since the data is stored in relational databases this model gives the appearance of traditional OLAP’s slicing and dicing functionality. The advantages of this model is it can handle a large amount of data and can leverage all the functionalities of the relational database. The disadvantages are that the performance is slow and each ROLAP report is an SQL query with all the limitations of the genre. It is also limited by SQL functionalities. ROLAP vendors have tried to mitigate this problem by building into the tool out-of-the-box complex functions as well as providing the users with an ability to define their own functions.
HOLAP technology tries to combine the strengths of the above two models. For summary type information HOLAP leverages cube technology and for drilling down into details it uses the ROLAP model.
Comparing the use of MOLAP, HOLAP and ROLAP
The type of storage medium impacts on cube processing time, cube storage and cube browsing speed. Some of the factors that affect MOLAP storage are:
Cube browsing is the fastest when using MOLAP. This is so even in cases where no aggregations have been done. The data is stored in a compressed multidimensional format and can be accessed quickly than in the relational database. Browsing is very slow in ROLAP about the same in HOLAP. Processing time is slower in ROLAP, especially at higher levels of aggregation.
MOLAP storage takes up more space than HOLAP as data is copied and at very low levels of aggregation it takes up more room than ROLAP. ROLAP takes almost no storage space as data is not duplicated. However ROALP aggregations take up more space than MOLAP or HOLAP aggregations.
All data is stored in the cube in MOLAP and data can be viewed even when the original data source is not available. In ROLAP data cannot be viewed unless connected to the data source.
MOLAP can handle very limited data only as all data is stored in the cube.
Finally, what we’ve all been waiting for, today the entire next wave of Microsoft Business Intelligence is available in Beta. Grab yourself a copy of Microsoft Office 2010 beta, Microsoft SharePoint Server 2010 beta, and SQL Server 2008 R2 CTP3 and try out the exciting new BI capabilities from Microsoft.
Take a look at the new BI capabilities available with SQL Server in Microsoft website with Master Data Services, the new Report Builder, and more…
Top New Features Create high-performance Analysis Services solutions with optimized cube designers, subspace computation, and MOLAP-enabled writeback capabilities Implement enterprise-scale Reporting Services solutions through new on-demand processing and instance-based rendering Build flexible and effective reports with the new Tablix data structure and rich formatting capabilities Expand reach, and empower more users through optimized integration with the 2007 Microsoft Office system.