The Modern Role of the Agile Business Analyst

[article]
Summary:
The business analyst (BA) has played a key role in software development. But within a modern agile context, the role of the BA is less clear, and there is some confusion as to whether the product owner role subsumes that of the traditional BA. Let’s look at the roles the BA can play with agile teams and how to fully leverage their expertise to supplement or augment that of the product owner.

Business analysts (BAs) have played an important role in software development for several decades. In waterfall development, the BA was responsible for eliciting requirements from customers and subject matter experts and writing business requirements documents. Additionally, BAs often participated in or led the formal or informal testing after the development phase was completed.

Fast-forward to agile, and in particular the Scrum framework, and there is no defined role for the BA. The Scrum Guide defines three roles: product owner, ScrumMaster, and development team. Even teams practicing a framework other than Scrum, such as kanban or Scrumban, often stick with these three roles.

So, where does this leave the BA? Is there a role to play for these members of the organization who typically have valuable expertise in the problem domain? Fortunately, the answer is an emphatic yes, though the exact role may vary somewhat from team to team within an organization.

As Roman Pichler points out in his blog on Business Analyst as Product Owner, in some cases, the BA may transition into the product owner role. This is often a natural career move for a BA, but not in all cases. For example, some BAs prefer not to step into the type of leadership and customer-facing role that is required of product owners. These BAs prefer to work in the background in more of a supporting role. They may be full-fledged development team members, often depending on whether they support one or multiple teams. In this role, they will typically pick up some of the responsibilities of the product owner, which could include user story writing and accepting, coordination of user or SME acceptance testing, etc.

But wait: Pichler also warns in his blog to avoid the proxy product owner trap, in which the BA or proxy product owner acts as a go-between the real decision maker and the development team. How do we reconcile this apparent conflict?

The answer ultimately lies in pragmatism, which, as agilists, we should always embrace, because it’s consistent with our mindset. We inspect and adapt to find the best solution to problems, with the understanding that the best solution for one situation may be different from that for another situation. To elaborate, I will provide two examples from groups I have worked with.

A Tale of Two Agile Organizations

The first example is with a set of seven agile teams that support a web platform consisting of several large applications. These teams do not have product owners assigned to the individual teams. Instead, two product managers are responsible for the product roadmap and prioritizing features for releases, in addition to interacting regularly with customers. The day-to-day role normally filled by product owners is supported by a group of five BAs who are responsible for writing user stories and working with the teams on a daily basis.

Effectively, these BAs function much like product owners, albeit without the customer-facing part of the job—and, perhaps more importantly, without the positional authority to make decisions that is typical of product owners. For this reason, it would seem to be less than ideal; however, the BAs’ ability to provide value is based more on their relationships than their position in the organization. Specifically, as the product managers become more comfortable with the BAs’ decision-making and overall understanding of the applications, they provide more autonomy for the BAs to make decisions typical of a product owner. In a similar fashion, the development teams, with time, recognize the BAs as the final authority for most day-to-day questions about user stories and related product decisions.

The second example is with a division of our company that builds and delivers features for their financial services clients’ web applications. They have roughly thirty teams that do this feature development. Each team supports anywhere from one to eight clients, depending on the size of the client and the amount of contracted work. Last year, this division underwent an agile transformation, and each team was assigned a product owner and a ScrumMaster.

Recently, I had the opportunity to visit this division with my colleague Doug Husovsky. We had conducted the training for the agile transformation and were returning to get some feedback on how the transformation was progressing. (Note that this was not cargo cult agile; Doug had the opportunity to spend a few months after the training was completed to regularly visit the division in a coaching capacity.)

When we sat down with a few of the product owners, we learned that they were spending most of their time in conversations with their clients, and they would scramble to find a few hours of time to write user stories just ahead of the next sprint. This is obviously not a winning formula for creating quality user stories. Moreover, these product owners clearly did not have enough time to interact with the development team as needed throughout the day in order to ensure questions were answered promptly as they arose during user story development and testing.

As we walked out of that meeting, it occurred to Doug and me that adding some agile BAs to assist the product owners could be a solution that would ensure the product owners are not the bottleneck in the development process. We were pleased when we ran into one of the site leaders shortly thereafter and learned they were already in the process of implementing this solution. Because the product owners in this example are in a one-to-one relationship with the teams, I’d expect them to maintain most of the ultimate decision-making on product direction, though it’s likely to vary from team to team. Doug and I look forward to following up in a few months to see how well the agile BA model is working for these teams.

Create the BA Role Your Team Needs

In addition to playing the product owner proxy or filling in for some of the product owner responsibilities that have been detailed above, agile BAs can add value to a development team in many other ways.

For example, BAs can assist or play a lead role in many of the product discovery activities that were elaborated on in Teresa Torres’s recent blog What a Good Continuous Discovery Team Looks Like, including qualitative and quantitative data analysis, opportunity assessments, designing product experiments, and much more. Clearly, BAs can support agile teams in many different ways, though the role can and should be dependent on the needs of a specific team or set of teams.

I encourage you to think beyond the traditional duties of the BA in the pre-agile context and instead think about the role in terms of what you and your team really need.

User Comments

8 comments
Sanket Doshi's picture

You may not be able to see a “business analyst” job title in an Agile team. But wherever the value of the team to the organization is addressed, someone performing business analyst tasks is going to be required. That opens quite a lot of opportunities for a business analyst, including the critical role of the Product Owner.

May 29, 2018 - 6:54am
Rich Stewart's picture

Great point Sanket and you've hit upon a key point that much of what the traditional business analyst did in support of a team still needs to be done, albeit in different forms (e.g. requirements -> user stories), and what really matters is that any gaps are addressed regardless of official title.

July 21, 2018 - 11:58am
Clifford Berg's picture

The BA role is crucial. Early Agile did not recognize it, as it did not recognize many things. Scrum in particular defines a very narrow and ineffective structure for an Agile team. That's why organizations that do this at scale don't use Scrum. (E.g., read Spotify's blog.)

If you throw ATDD/BDD into the mix, which you should (how else are you going to automate your integration and acceptance tests?), then the BA role becomes indispensable for defining the detailed test scenarios: the PO does not have time to do that - it is too down in the weeds. My LinkedIn article series on BDD explains the process: https://www.linkedin.com/pulse/how-does-behavior-driven-development-bdd-work-agile-setting-berg/

November 16, 2018 - 12:49pm
Rich Stewart's picture

Thanks for sharing this book, Michele, I'll definitely check it out.

My only counter to the need for any specific role is from an insight I've recently gained from Mike Cottmeyer, CEO of Leading Agile. Mike makes the point that the specific roles are less important than certain things that just have to happen for an Agile team to be successful. His talk can be viewed here: https://www.leadingagile.com/resource/why-agile-is-failing-in-large-ente...

 

January 4, 2021 - 8:07pm
Michele Downey's picture

Thanks for pointing me to the video, Rich!  Great talk!  Found the book to be more about the high value functions that a skilled Business Analyst can do to support the team (and the business) than assigning specific roles. It has helped us to break down barriers and dependencies across the organization (well, many of them!)  Our backlogs are much more relevant to what the business really needs and the products we deliver are worlds better than they ever were before.

January 5, 2021 - 2:15am
Laszlo Toth's picture

I agree with the article, I think BAs play a crucial role in an agile team. But may you have any statistical data, to prove it? 

May you have any statistic about a team who worked without a BA, and after working with a BA? 

For example: 

- how many storypoints have been finished before and after a BA joined the team?

- how many hours a BA have saved for the programmers (who could write code instead of running after business requirements)

- how a BA has reduced the fluctuation of an agile team (because programmers burned out later, thanks to less contact with the business)

 

May you have any data, how you can prove the effectiveness of a BA? 

March 4, 2021 - 3:55pm

About the author

AgileConnection is a TechWell community.

Through conferences, training, consulting, and online resources, TechWell helps you develop and deliver great software every day.