I’m speaking at #ITDevConnections 2018!

ITDev Connections Side Banner

I’m speaking at #ITDevConnections 2018! Join me in Dallas and learn on topics such as:

  • Blockchain Demystified for Business Intelligence Professionals
  • Data Analytics with Azure Cosmos Schema-less Data and Power BI
  • R in Power BI for Absolute Beginners

There is also a Women in Technology lunch and I’m excited about that, too!

Join me in Dallas this October!

I’m excited to see that some of my SQLFamily friends are going, such as Mindy Curnett, Kevin Kline, Bob Ward and Tim Mitchell. I’m looking forward to going to sessions as an attendee, too!

You can find the agenda here.

SPECIAL OFFER:Use promo code STIRRUP by September 7 and save on your pass!*

  • All Access Pass – $1899 with code STIRRUP (a $2699 value)
    Includes Pre-Conference workshop plus 200+ sessions and networking
  • Essentials Pass – $1199 with code STIRRUP (a $1799 value)
    Includes 200+ sessions and networking

All Access Pass – $1899 with promo code STIRRUP (a $2699 value) 

Includes everything listed in the Essentials Pass, PLUS you gain access to one Pre-Conference Workshop, where you’ll spend a full day in the classroom with our experts.

Choose from 8 workshops:

  1. Migrating to Windows 10 – Notes From the Field
  2. Mastering ASP.NET Core, Angular 6 and EF Core
  3. From Beginning to Expert SQL Programmer in One Day
  4. Progressive Web Apps From Beginner to Expert
  5. ConfigMgr and Azure – A Flexible, Powerful and Compelling Combination
  6. Practical Performance Monitoring
  7. Build Intelligent Applications with A.I. Technologies
  8. Going Serverless Using Azure

Essentials Pass – $1199 with promo code STIRRUP (a $1799 value)

Includes:

  • Mix and Match 150+ Tracks/Sessions
  • Access to Session Presentation Materials
  • Vendor Receptions
  • Networking Events
  • Breakfast and Coffee Breaks
  • Networking Luncheon
  • Conference Registration Giveaway
  • and more!

*Prices increase after September 7, 2018. Must use code to receive discount. Non-transferable. Cannot be applied to previously paid registrations.

Fun DataDive with DataKind UK

This weekend, I volunteered with DataKind UK on their Summer DataDive, which took place on the weekend of 28th and 29th July 2018 in the Pivotal London offices in Shoreditch. I had a fantastic, memorable weekend, mixing with around 200 other data scientists.

I’d like to thank the DataKind team for being so inspirational, giving, and kind with their time and skills. I’d like to emphasise my absolute admiration for the Data Ambassadors and the work that they do to lift everyone up.

Why did I do this? DataKind appealed to me since it meant that I could sharpen my data science skills  by pitching in with experts. New learners to Data Science are welcome, and there were also newbies who had some experience of data and wanted to know more. There was room for everyone to contribute, so if you are a newbie, it would be a great way to join in the conversations and learn from experts who love what they can achieve with data. Plus, it’s a great opportunity to mix with real data scientists. This isn’t Poundland data science, and this is not pseudo Data Science. This is the real thing; and I spent two days immersed in real problems using Data Science as a solution. I learned a lot, and I contributed as well. There is a saying that you are the average of your friends, and I needed to get close to more Data Scientists so that I could build on my earlier experience on AI and bring it up-to-date.

I wanted to help a charity, by dedicating my time and skills, to support women and girls who need it. I understand that there are vulnerable men too; but this isn’t about whataboutism. Women and girls are disproportionally affected by issues such as domestic violence and being the victims of sexual crimes, and I wanted to do something practical to help.

Lancashire Women's Centres LogoFor my specific contribution, I was working with a team of 25 other data scientists, we worked on finding insights in data belonging to Lancashire Women’s Centre. The vision of Lancashire Women’s Centre is that all women and girls in Lancashire are valued and treated as equals. Their aim is to empower women and girls to be able to transform their lives by bringing them together to find their voice, share experiences and understanding, develop their knowledge and skills, challenge stereotypes and misconceptions about them so that they can have choices in becoming the individuals they want to be. I share this conviction deeply and I wanted to help.

You may well be thinking that the charity help a small number of women, but that’s not the case at all. They have a real impact in their community. The Lancashire Women’s Centre has helped over 3000 women in the last year. This includes 5807 hours of therapeutic support were accessed by 1154 women and 78 men.  Following therapy: 25% were no longer taking medication, 8% felt the support had helped them find and keep a job, 12% continued to access LWC services to support their recovery.

So what did I do? I can’t share specific details because the data is confidential, and it obviously impacts some of the UK’s most vulnerable women and girls. I will say that the tools used were CoCalc, R, Python, Excel and Tableau and Power BI to work with the data.

DataKind™ brings high-impact organizations dedicated to solving the world’s biggest challenges together with leading data scientists to improve the quality of, access to and understanding of data in the social sector. This leads to better decision-making and greater social impact. Launched in 2011, DataKind leads a community of passionate data scientists, visionary partners and mission-driven organizations with the talent, commitment and energy to use data science in the service of humanity. DataKind is headquartered in New York City and has Chapters in Bangalore, Dublin, San Francisco, Singapore, the UK and Washington DC. More information on DataKind, our programs and our partners can be found on their website: www.datakind.org

Lancashire Women’s Centre

DataKind JenStirrup and Team

I’m the one on the right, wearing orange!

I’m looking forward to the next one!

Tableau Prep, Power Query and Power BI – Good together?

A question I often here is this: Which tool should I use, Tableau or Power BI? The truth is: They are not mutually exclusive.

Tableau is great at business mysteries: ill-defined questions where you have to surf the data for results. Power BI is particularly great at modelling and cleaning the data, with clean, crisp data visualisation and the ability to use custom and open-source data visualizations. This blog isn’t aimed at the technical user, but at the analyst who needs to get information out quickly. I will do another post, aimed at the geeks, another time.

Tableau and Power BI are paintbrushes for your data. The tools do not have to be mutually exclusive. Power BI contains some superb data preparation functions which are aimed at business users. Speaking to customers, however, it’s clear that they aren’t aware of its functionalities. So, I decided to make your life easier for you by helping you to compare the two, using the same data with the same result.

In the first video, we will look at Tableau Prep in some detail. We will use one of the Tableau datasets, Superstore, and we will work through one of Tableau’s own tutorials.
In the next segment, I repeat the exercise using Power BI and Power Query so that you can compare more easily. Ultimately, both tools achieve the same ends.

Where Tableau Prep falls down, in my opinion, is that Tableau Prep does not handle complex pivots very well. In the World Data Bank data, the Life Expectancy data which was made famous by Hans Rosling is available, and this data needs pivoted in order to be visualized effectively. Tableau needs a lot of branching pivots to get it to work. Power BI, on the other hand, pivots it within a few clicks. What do we take away from this?

  • Tableau Prep is great for simple data preparation tasks
  • Power Query, also known as Get and Transform in Excel, is great at simple and much more complex and difficult data preparation tasks.

So, which tool you use will depend on the data prep that you need to do. If it is easy, use Tableau Prep. If it is anything above easy, or includes easy, use Power Query.

You can use Power BI to shape the data, and then use the data in Tableau. See? You don’t have to choose. Select the best paintbrush for what you need to do, and you are not restricted to one paintbrush.

To see the videos, go here:

Tableau Prep: An Overview

 

Power Query and Power BI Together for Tableau Users:

 

 

Microsoft Data Insights – Digital Transformation with Power BI for the CEO

I’m holding a series of training courses around the UK, more details will be published. In the first instance, on 15th September, I’ll be holding a day-long practical workshop on Working with Business Data for Busy Executives in SME Organisations in Hertfordshire, England. The cost will be £100 pounds plus VAT, food and workshop materials included, and you can also network and share experiences with other attendees who will also be running businesses, like you.

I don’t believe in a ‘stack ’em high’ approach, which doesn’t give a pleasant experience for learning. So, classes will be restricted to 12 people only, unless otherwise stated. This means that you will get a good amount of attention.

I’m doing the Executive MBA at the University of Hertfordshire Business School, I’ve also been a NED (Non Executive Director) for PASS, who are based in the United States.  As I’ve been spending time leading organisations, I’m keen to share this knowledge and expertise with the community from a data-driven, data leader perspective. The following blog post will give you a flavor of the workshop. along with some of my thoughts on Microsoft Data Insights Summit. If you have any questions, please pop them in the comments box and I’ll read them from there.

Here are my slides from Microsoft Data Insights Summary, combined with some of the slides from the keynote by James Phillips, held in June 2017.

Slide1

For those of you who know me, you’ll know that I have extensive experience in Tableau as well as Power BI. However, most of my consulting data visualisation is in Power BI suite of products. Why is that?

Tableau is wonderful at data visualisation, as is Power BI, of course. However, for enterprise customers, where I’m building a data warehouse, I prefer having analytics closer to the data source, perhaps in a data warehouse or data lake. I like to think about the overall business intelligence architecture. Tableau is superb at data visualisation and it also cleans and integrates data, but to a much lesser extend, which is why they partner so well with Alteryx. I don’t like cleaning data or doing repeatable analytics so close to the end reporting layer and business people seem to want to do it there, without thinking of issues such as robustness, repeat-ability and longevity in the analytical formula that they are creating. I prefer to hand off clean data and analytical formula to the reporting tool as far as possible.

I’m not thinking about Business Intelligence in terms of a spot solution for data visualisation or reporting, for example. I’m looking at the whole canvas. I prefer to clean the data and have it all fixed closer to the source, so that I can get the same number for the same report, regardless of the reporting technology that I use. With Power BI, I can stay within the Microsoft playpen of technologies. I do note however that Tableau Server is in Azure and if you are looking at analytics, that’s another option so that the analytics formula isn’t contained in disparate workbooks. Instead, they are published to Tableau Server and people can should download their workbooks there, for ‘one version of the truth’.

As an external consultant, I work with Power BI because I think it has an astonishing reach technically as well as geographically. Some of my customers are global and I really need the certainty of global resiliency.. Gone are the days when Microsoft had a lot of disparate reporting technologies that didn’t talk to one another very well and we had lots of different interfaces that used to overlap. Customers got really confused about what to use. For example, do you put your KPIs in Analysis Services, or in Reporting Services? Now:

The answer is always Power BI! Take a look:

Microsoft Data Insights Summit

Apart from Data Visualization, what is Power BI useful for?

Power BI is particularly useful for:

  • businesses that are acquiring other businesses and they need somewhere to put the data, and keep the business running in the meantime
  • cost savings
  • GDPR – if you don’t know what this is, you need to contact me to find out more. Microsoft are in the forefront of working with customers to make sure that they are compliant.

Do I still see Tableau?

Yes – some of my customers don’t need public cloud because they pop up their own data centres if and when and where they need them. So, for them, they tend to stick with what they know, and what works for them.

What Business Intelligence tools do I see less of?

I see Qlikview less and less, as customers look to align their reporting and they can replicate their Qlik scripts in SQL Server and SSRS.

I also don’t see Pyramid Analytics appearing much, and I don’t get asked often about them. According to the Gartner report, 2017 may represent a critical period for the company and, rightly or wrongly, the Gartner Magic Quadrant does carry enormous weight when customers are looking for solutions. With many solutions, customers don’t use the full range of features contained in any technical solution, and Pyramid are going to have to work hard to explain how they compare / compete with the Power BI on-premise solution, which is going to go from strength to strength.

However, for others, particularly in the SME market, the Azure offering is extremely compelling. Power BI and Azure together mean that you can focus on the business, rather than working on the technology to support the business. I can also see that more and more data is going into the cloud, and I am part of projects where I am doing exactly that – cloud business intelligence. Cloud Business Intelligence is a real growth offering for me and I plan to keep being ahead of the curve.

Microsoft Data Insights Summit

Are people using Power BI or is it simply good Microsoft Marketing?

People are using it, yes. Here are the numbers, produced by James Phillips during the Power BI Keynote: Microsoft Data Insights Summit

Power BI and the C-Suite

Given it’s reach within the organisation, Power BI can reach the C-suite level as well as the rest of us, in the organisation. Before continuing, it’s probably worth reading about linear vs exponential business growth models e.g. HBR.

 

You can watch the video below, or read on for some of the headlines:

Here are some headlines:

Gross and Net Profit

Net profit

Progress Towards Targets

Revenues and revenue growth rate

Expenses

Employee Engagement

Let’s get started!

Gross and Net Profit

Slide18 Why do CEOs care? As part of the Digital Transformation process, the CEO must develop a guiding philosophy about how he or she can best add value whilst showing ongoing strategic assessment and planning. However, it is difficult for them to allocate time to the collection, cultivation and analysis of data. Instead, they need to focus on strategic decisions, and they need data to run their business, to understand how their customers behave and measure what really matters to the organization. Power BI can help to bring clarity and predictability to the CEO, and this session is aimed at CEOs, and those who support them with data, in order to see how they can be empowered by Power BI, and see it as a key asset within the organisations short and long term future. Slide16

Net Profit

This goes without saying, but keeping an eye on net profit at all times is essential for business leaders. This might be visualized as a line graph or quarterly chart. However you decide to represent the data, it needs to provide detailed, regularly updated information. You can get added value by allowing this data to be broken down.
With Power BI, you’d be able to tap your chart and see real-time data on profits by region, product type or team. First you calculate your gross profit, then your expenses, subtract expenses from gross profit, and you have net profit.

Calculate Gross Profit first:
Gross profit, also called gross margin, shows you how much money you made from selling a product.
It subtracts the selling price from your wholesale cost to calculate the difference. It does not take into account expenses from rent, personnel, supplies, taxes or interest. Gross profit is a required step toward calculating the company’s income or net profit.

Progress Towards Targets

You can use EXPON.DIST function in Microsoft Excel to help measure progress towards your targets.
Use EXPON.DIST to model the time between events, such as how long from the order placement takes to actual delivery. For example, you can use EXPON.DIST to determine the probability that the process takes at most 1 minute.

Revenues and revenue growth rate

By being able to instantly visualize how fast (or otherwise) your business is growing its revenues, it’s much easier to find out what’s going right and what’s going wrong. Need to lose some dead weight? Invest in a growing department? Respond to a new trend among consumers? Tracking your revenues closely is crucial and will help with those decisions. A line graph would again be particularly clear in this instance.

Slide22 Slide21

Think of a Rubik’s cube – people instinctively know how to use them, and to arrange the cube into colors. We also interact with colour and data in the same way; intuitively and quickly.

Expenses

Whether it’s staff, machinery, IT or property, your expenses are one of the biggest drains on your long term success. A dashboard can break these down instantly so you can see where your biggest outgoings are, and then make decisions about what’s costing too much.

Revenue per employee
Revenue per employee is a little like Return on Investment. Are your people actually making enough revenue to justify hiring them? Are they working at 100% capacity or is there room for them to work more, instead of employing new workers? A revenue per employee dashboard helps you make these choices rationally.

Employee Engagement

Measured by an anonymous survey, employee engagement is a key BI factor for any CEO. If your people are motivated, enthusiastic and giving their work 100%, you can be sure your company will grow. By contrast, unengaged colleagues will be a detriment to productivity. It’s essential to keep regular tabs on how employees are feeling about their work.

 

Summary

As part of the Digital Transformation process, the CEO must develop a guiding philosophy about how he or she can best add value whilst showing ongoing strategic assessment and planning. However, it is difficult for them to allocate time to the collection, cultivation and analysis of data. Instead, they need to focus on strategic decisions, and they need data to run their business, to understand how their customers behave and measure what really matters to the organization.
Power BI can help to bring clarity and predictability to the CEO, and this session is aimed at CEOs, and those who support them with data, in order to see how they can be empowered by Power BI, and see it as a key asset within the organisations short and long term future.

Five reasons to be excited about Microsoft Data Insights Summit!

ms-datainsights_linkedin-1200x627-1

I’m delighted to be speaking at Microsoft Data Summit! I’m pumped about my session, which focuses on Power BI for the CEO. I’m also super happy to be attending the Microsoft Data Summit for five top reasons (and others, but five is a nice number!). I’m excited about all of the Excel, Power BI, DAX and Data Science goodies. Here are some sample session titles:

Live Data Streaming in Power BI

Data Science for Analysts

What’s new in Excel

Embed R in Power BI

Spreadsheet Management and Compliance (It is a topic that keeps me up at night!)

Book an in-person appointment with a Microsoft expert with the online Schedule Builder. Bring your hard – or easy – questions! In itself, this is a real chance to speak to Microsoft directly and get expert, indepth  help from the team who make the software that you love.

Steven Levitt of Freakonomics is speaking and I’m delighted to hear him again. I’ve heard him present recently and he was very funny whilst also being insightful. I think you’ll enjoy his session. You’ll know him from Freakonomics.

freakonomics

I’m excited that James Phillips is delivering a keynote! I have had the pleasure of meeting him a few times and I am really excited about where James and the Power BI team have taken Power BI. I’m sure that there will be good things as they steam ahead, so James’ keynote is unmissable!

Alberto Cairo is presenting a keynote! Someone who always makes me sit up a bit straighter when they tweet is Alberto Cairo, and I’m delighted he’s attending. I hope I can get to meet him in person. Whether Alberto is tweeting about data visualisation, design or the world in general, it’s always insightful. I have his latest book and I hope I can ask him to sign it.

003b6f66

Tons of other great speakers! Now someone I haven’t seen for ages – too long in fact – is Rob Collie. Rob is President of PowerPivotPro and you simply have to hear him speak on the topic. He’s direct in explaining how things work, and you will learn from him. I’m glad to see Marco Russo is speaking and I love his sessions. In fact, at TechEd North America, I only got to see one session because I was so busy with presenting, booth duty etc… but I managed to get to see a session and I made sure it was Marco Russo and Alberto Ferrari’s session.  Chris Webb is also presenting and his sessions are always amazing. I have to credit Chris in part for where I am today, because his blog kept me sane and his generosity during sessions meant that I never felt stupid asking him questions. I’m learning too – always.

Ok, that’s five things but there are plenty more. Why not see for yourself?

Join me at the conference, June 12–13, 2017 in Seattle, WA — and be sure to sign up for your 1:1 session with a Microsoft expert.

Why UK Power BI Summit? Derive business value from your data

I’ve created UK Power BI Summit in response to an industry need for Power BI to have its own event, and I hope to produce a repeatable model for other Power BI groups globally. I am working with Microsoft in Redmond at the moment, in the hope that I can spread the world globally about the power of enabling businesses through data, via easily-accessible tools.

What’s the rationale? Personally, the next step in my career is to continue my trajectory from the data center towards boardroom level leadership and consultancy, in order to help organisations become 21st century, data-driven organisations. Data is at the foundation of businesses. Data, in turn, leads to insights and better decisions that improve the business. Ideally, businesses should have data as part of their DNA. This does not mean that there is not a place for context or for ‘gut instinct’. Data gives businesses new insights, and, in turn, it gives them new options.

tumblr_lxrqzlzskr1qdo62to1_500

My favourite bookshop in the world: The Strand Bookstore, New York, on the corner of Broadway and E 12th Street.

With my business and technical skills in mind, I am doing my MBA at this stage in my career to focus on building businesses as data-driven organisations. The MBA will help me to combine my technical and business expertise within an established framework that will help me to be more effective in a leadership role. I believe that the MBA will help me to articulate and achieve a strategic viewpoint, which, in turn, will help businesses to use their data more effectively.

I am not alone in this data-driven journey. My industry experience tells me that many organisations suffer from one thing: hype about the possibilities and opportunities in data, and, particularly Big Data, but they don’t know how to get started in terms of technology, people, and enabling business processes that would consume these services.

Organisations can find it difficult to know where to start, or even how to start. Very often, businesses simply store all of their data, rather than think proactively about the data that they have, and how they could use it. As businesses continue to get excited about the opportunities of Big Data, they will also need Data Thought Leadership in order to guide them effectively towards success.

Digital Transformation is a much bandied about term. It isn’t simply whacking a few Virtual Machines in Azure, moving data to the cloud and – yay – digital transformation. It’s about transforming the business through the use of technology, and it has the business at the front-and-center of the activity.

Now is the time for businesses to bring their data and their strategy together, using the latest technologies – but they can’t do that, until they see their data. This is where Power BI come in.

Processed with VSCOcam with hb2 preset

The Power BI event is aimed at those people in the organisation who are aware of business needs, user needs, and have winning ideas and who are willing to learn about user-oriented technology to make that happen. The event is aimed at helping these people to learn about the technology from beginner to advanced, according to their needs.

Although the event is about technology, it’s also about the business, and deriving business value from your data. It’s not a straightforward technology event. It’s about the business as well as the technology, and how it’s used. It’s about bringing you along the journey, further.

I thought that the difference between UK Power BI Summit and other events such as PASS SQLSaturday events, SQLBits were fairly clear, but it would seem from my email traffic that my assumption wasn’t correct.

Just to be clear:

  • I am not part of the SQLBits committee and I have nothing to do with their leadership. I don’t represent them and I’m not featured on their promotional video. I’ve been speaking there since SQLBits 7 through to SQLBits XV. You can look for my SQLBits 7 – 15 sessions here.
  • I am part of PASS and a non executive Director, and I sit on the PASS Board as an elected Director. I don’t represent PASS here. If you want a PASS-validated blog, then please head over to their site. This isn’t a PASS event.

Let’s look at the SQLBits mission statement, taken from their site:

SQL Bits was started by a group of individuals that are passionate about the SQL Server product suite. There is a breadth of knowledge in the SQL Community that will benefit everyone in the community. We want to spread that knowledge. We all work with the SQL community, some of us for many years and have all been given the MVP award by Microsoft.

Let’s look at the PASS Mission Statement, taken from their site:

PASS is an independent, not-for-profit organization run by and for the community. With a growing membership of more than 100K, PASS supports data professionals throughout the world who use the Microsoft data platform.

PASS strives to fulfill its mission by:

  • Facilitating member networking and the exchange of information through our local and virtual chapters, online events, local and regional events, and international conferences
  • Delivering high-quality, timely, technical content for in-depth learning and professional development

PASS was co-founded by CA Technologies and Microsoft Corporation in 1999 to promote and educate SQL Server users around the world. Since its founding, PASS has expanded globally and diversified its membership to embrace professionals using any Microsoft data technology.

So, the UK Power BI Summit is ultimately looking at using Power BI to transform businesses, through expertise in the technology, embedded in business-oriented discussions. The technology should support the business in its mission to adapt to the new world of data.

If you’d like to register, click below:

Eventbrite - UK Power BI Summit

UK Power BI Summit

I’m very proud to say that I’m the lead organiser for the UK Power BI Summit, held on 16th and 17th February! I’d like to thank Microsoft and Pyramid Analytic for their support of the event; it wouldn’t happen without them.

Need help on Power BI, or just to know how to get started throughout the organisation? What about Cortana – how can it be useful for your organisation?

Come and join Siva Harinath and Will Thompson, flying in from Microsoft’s Power BI Team in Redmond, to join us in the UK for the inaugural UK Power BI Summit! Siva and Will are delivering the keynote and also delivering a workshop on Advanced Power BI with Data Modelling.

When: 16th and 17th February 2017 

Where: Shendish Manor, Hemel Hempstead.

Cost: of the event is £120 inclusive of VAT. Click here to register and pay for UK Power BI Summit

 

A choice of hands-on workshop on Thursday 16th February:

  • AzureML and Cortana OR
  • Advanced Power BI with Data Modelling

AND

  • A choice of general conference sessions on Friday 17th February
  • Birds of a Feather roundtable discussions on Friday 17th February

See you there!

Click here to register and pay for UK Power BI Summit