VSTS Timetracker performing slowly

Implemented

Comments

28 comments

  • Avatar
    Maxim

    Hi Jack, 

    We are investigating it right now. I'll post update here later.

    Maxim

    0
    Comment actions Permalink
  • Avatar
    Marc Schaeffler

    We confirm there are performance issues since today and we are working on it.

    0
    Comment actions Permalink
  • Avatar
    Maxim

    Timetracker performance should be back to normal for all users.

    Please update us if you still experience any issues.

    Maxim

    1
    Comment actions Permalink
  • Avatar
    Daniele Sala

    Hi, I have the same error right now

     

    0
    Comment actions Permalink
  • Avatar
    Jack

    Yes it was looking better on Friday, but we've had a few errors today.

    0
    Comment actions Permalink
  • Avatar
    Marc Schaeffler

    We still have issues with performance and we are working on it with highest prio.

    0
    Comment actions Permalink
  • Avatar
    Maxim

    Hi all,

    we are working on performance improvements right now. We underestimated load of server side tracking and the load generated by it is bigger than we expected. 

    I will continue posting updates on our progress.

    Maxim

    0
    Comment actions Permalink
  • Avatar
    Asbjørn Riis-Knudsen

    We've not had many problems the other days, but today the connection issues are terrible. It is nearly impossible to use TimeTracker and at has gotten progressively worse (probably due to increased load, I guess).

    0
    Comment actions Permalink
  • Avatar
    Valery Lebedz

    This is a real pain, is there any date on when this is expected to be resolved?

    2
    Comment actions Permalink
  • Avatar
    Luis Carlos Pignataro

    Same problema here!

    0
    Comment actions Permalink
  • Avatar
    Chris van Dam

    Performance is terrible; please try to fix this as it is pretty unworkable right now.

    0
    Comment actions Permalink
  • Avatar
    Ross Ellerington

    Any update on this?  We're experiencing big performance issues since rolling it out across the team.  May need to seek an alternative if it's not resolved quickly

    1
    Comment actions Permalink
  • Avatar
    Neil Ferguson

    Hi, Trying to update time sheets and run monthly report. It is excruciatingly slow. Do you have any status updates on this service please. Thanks

    1
    Comment actions Permalink
  • Avatar
    Sylvester Bos

    Hi, we have the same problem here. We planned to introduce TimeTracker tomorrow for 100+ users, but with this performance that is not feasible. Quick resolution is desired.

    1
    Comment actions Permalink
  • Avatar
    Leah Copeland

    Thank you for reporting the issues and for your patience. 

    Our development team recently corrected an internal/MS services issue. Please let us know if this has helped on your end.

     

    1
    Comment actions Permalink
  • Avatar
    Luis Carlos Pignataro

    Today!!! Please check this.

    0
    Comment actions Permalink
  • Avatar
    Neil Ferguson

    Just checked now and is working fine here, fast actually.

    0
    Comment actions Permalink
  • Avatar
    Sylvester Bos

    It's working fine again, thx. Performance also seems to have improved.

    0
    Comment actions Permalink
  • Avatar
    Maxim

    Hello everyone,

    Short brief from us: yesterday cache system we are using stopped responding quickly and this was leading to long requests to it. This caused that Timetracker started slowing down and finally stopped working. 

    We changed both settings of Timetracker and scaled up caching system and it should be back to good performance. Sorry for that incident.

    Maxim

    0
    Comment actions Permalink
  • Avatar
    Ross Ellerington

    Are there problems again?

    0
    Comment actions Permalink
  • Avatar
    Chris van Dam

    Experiencing problems here again, too!

    0
    Comment actions Permalink
  • Avatar
    Jose Guaring

    we are having issues with TimeTracker, looks like TimeTracker app pool is taking up so much resource that its bringing the TFS App server to a crawl

     

    0
    Comment actions Permalink
  • Avatar
    Maxim

    Hello everyone,

    it took a while but we finally can say that Performance leaks and issues are eliminated from now on.

    With release of v4.5.0 (https://support.7pace.com/hc/en-us/articles/360000193963-7pace-Timetracker-for-TFS-VSTS-4-5-0-2018-02-13) we did many architectural changes under the hood and took performance back under control.

    Brief retrospective from me about what happened and what we did wrong: when we released Server Side Tracking we released persistent connection of all the pages of Timetracker and they were holding it. In addition: Start Tracking button on every Work Item you open does the same. This was unexpectedly high load to our application instances and they or related services (like Redis) started to slow down and finally at certain point in time went into denial of service.

    Now Start Tracking button holds connection only when you track time on the item, otherwise it is not connected to server. Additionally we did tons of micro-changes that app is more stable and loads faster.

    But it is not the end and the work goes on!

    Thank you everyone for pointing us to right direction and for you patience.

     

    Maxim

     

     

    0
    Comment actions Permalink
  • Avatar
    7pace tech support

    Last week 4.8 update brings many improvements into performance. Times Explorer, Export and OData API are way faster now: https://support.7pace.com/hc/en-us/articles/360000571243-7pace-Timetracker-for-TFS-VSTS-4-8-0-2018-04-16

    Meanwhile we continue improvements, next big performance improvement comes to Timesheet soon.

    Tell us if you did not notice stability/performance improvements.

     

    Maxim Lutsan

    0
    Comment actions Permalink
  • Avatar
    7pace tech support

    Hi everyone, 

    I just reviewed this issue report and our progress and I can say that original problems reported here are finally solved with releases 4.8 and 4.9.

    Timesheet improvements are coming later this week with 4.10 version.

    I know that some parts of app can be (and will be) improved and we are constantly working on that. Later this summer we will boost API and Times Explorer performance, we started working on that already.

    Meanwhile according to our pingdom uptime monitor we have 99.97% update for the last 30 days. 

     

    Maxim Lutsan

    0
    Comment actions Permalink
  • Avatar
    Dmytro Prydatko

    Today I've noticed that 7pace is working very slowly in VSTS (Timetracker Version 4.13.0.21002).
    Monthly report just shows "Loading..." for about 70 seconds or even more and the details for the day loads very slowly as well.
    As I see, the reason of the problem is in the slow response from *.timehub.7pace.com.

    Are you aware of this problem?

    0
    Comment actions Permalink
  • Avatar
    7pace tech support

    Hi Dmytro,

    We are investigating this issue now, we see similar behavior for ourselves as well.

     

    Maxim Lutsan

    0
    Comment actions Permalink
  • Avatar
    7pace tech support

    Hi all, who had mentioned issues today. 

    We identified that our cache server caused some issues which lead to slow pages, errors and sometimes even EULA agreements. 

    Fixed, should work properly.

    Maxim Lutsan

    0
    Comment actions Permalink

Please sign in to leave a comment.

Powered by Zendesk